Skip to content

move BitPacked slice from kernel -> parent reduce#7195

Merged
a10y merged 4 commits intodevelopfrom
aduffy/slicey-boi
Mar 27, 2026
Merged

move BitPacked slice from kernel -> parent reduce#7195
a10y merged 4 commits intodevelopfrom
aduffy/slicey-boi

Conversation

@a10y
Copy link
Copy Markdown
Contributor

@a10y a10y commented Mar 27, 2026

This is free and cheap since we do not need to materialize any data to do it.

@a10y a10y requested a review from gatesn March 27, 2026 17:46
@a10y a10y added the changelog/chore A trivial change label Mar 27, 2026
@a10y
move BitPacked slice from kernel -> parent reduce
74a63f8 
This is free and cheap since we do not need to materialize any data to
do it.

Signed-off-by: Andrew Duffy <andrew@a10y.dev>
@a10y a10y force-pushed the aduffy/slicey-boi branch from 542d297 to 74a63f8 Compare March 27, 2026 17:46
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented Mar 27, 2026 •
edited
Loading

Merging this PR will degrade performance by 15.51%

❌ 2 regressed benchmarks
✅ 1104 untouched benchmarks
⏩ 1522 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation bitwise_not_vortex_buffer_mut[1024] 477.2 ns 535.6 ns -10.89%
❌ Simulation bitwise_not_vortex_buffer_mut[128] 317.8 ns 376.1 ns -15.51%

Comparing aduffy/slicey-boi (ba53919) with develop (1f3206f)

Open in CodSpeed

Footnotes

  1. 1522 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

@a10y
all better
b66783b 
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
@a10y a10y enabled auto-merge (squash) March 27, 2026 17:57
@a10y a10y requested a review from AdamGS March 27, 2026 17:57
@a10y
fix CUDA test to use reduce
de0277b 
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
@a10y a10y force-pushed the aduffy/slicey-boi branch from a8f99ac to 5414439 Compare March 27, 2026 18:21
@a10y
lockfiles
ba53919 
Signed-off-by: Andrew Duffy <andrew@a10y.dev>
@a10y a10y force-pushed the aduffy/slicey-boi branch from 5414439 to ba53919 Compare March 27, 2026 18:46
@a10y a10y merged commit 60847b0 into develop Mar 27, 2026
106 of 109 checks passed
@a10y a10y deleted the aduffy/slicey-boi branch March 27, 2026 18:58
@gatesn gatesn added the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 27, 2026
@github-actions github-actions Bot removed the action/benchmark-sql Trigger SQL benchmarks to run on this PR label Mar 27, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ba53919 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.069x ➖

datafusion / vortex-file-compressed (1.069x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 134533173 126126813 1.07
polarsignals_q01/datafusion:vortex-file-compressed 399649241 374494349 1.07
polarsignals_q02/datafusion:vortex-file-compressed 24374759 22215344 1.10
polarsignals_q03/datafusion:vortex-file-compressed 396283508 378781139 1.05
polarsignals_q04/datafusion:vortex-file-compressed 11912199 11277410 1.06
polarsignals_q05/datafusion:vortex-file-compressed 🚨 17787821 15233907 1.17
polarsignals_q06/datafusion:vortex-file-compressed 19621695 18735061 1.05
polarsignals_q07/datafusion:vortex-file-compressed 14697935 14282086 1.03
polarsignals_q08/datafusion:vortex-file-compressed 495665548 461185933 1.07
polarsignals_q09/datafusion:vortex-file-compressed 11161094 10739424 1.04

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.8%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.029x ➖
Shifts: Parquet (control) +2.9% · Median polish -0.1%

datafusion / vortex-file-compressed (1.000x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49162296 47363935 1.04
tpch_q02/datafusion:vortex-file-compressed 32859481 32501371 1.01
tpch_q03/datafusion:vortex-file-compressed 27721381 25649299 1.08
tpch_q04/datafusion:vortex-file-compressed 17982687 18287308 0.98
tpch_q05/datafusion:vortex-file-compressed 52114594 53682440 0.97
tpch_q06/datafusion:vortex-file-compressed 9559428 9671248 0.99
tpch_q07/datafusion:vortex-file-compressed 63195435 62654637 1.01
tpch_q08/datafusion:vortex-file-compressed 46121181 45037811 1.02
tpch_q09/datafusion:vortex-file-compressed 54557687 54952274 0.99
tpch_q10/datafusion:vortex-file-compressed 44485098 44578735 1.00
tpch_q11/datafusion:vortex-file-compressed 17845379 17591185 1.01
tpch_q12/datafusion:vortex-file-compressed 22302947 23435359 0.95
tpch_q13/datafusion:vortex-file-compressed 27220672 27362602 0.99
tpch_q14/datafusion:vortex-file-compressed 16217251 16494704 0.98
tpch_q15/datafusion:vortex-file-compressed 24704520 26571567 0.93
tpch_q16/datafusion:vortex-file-compressed 24531677 24001957 1.02
tpch_q17/datafusion:vortex-file-compressed 66111337 61408080 1.08
tpch_q18/datafusion:vortex-file-compressed 77503660 77427285 1.00
tpch_q19/datafusion:vortex-file-compressed 26418984 27268487 0.97
tpch_q20/datafusion:vortex-file-compressed 32204960 31882034 1.01
tpch_q21/datafusion:vortex-file-compressed 73061052 74867177 0.98
tpch_q22/datafusion:vortex-file-compressed 16481502 16812676 0.98
datafusion / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 57283807 60680083 0.94
tpch_q02/datafusion:vortex-compact 35774804 37091603 0.96
tpch_q03/datafusion:vortex-compact 31771622 31525385 1.01
tpch_q04/datafusion:vortex-compact 23004502 23081863 1.00
tpch_q05/datafusion:vortex-compact 56680038 54306680 1.04
tpch_q06/datafusion:vortex-compact 14327225 13787095 1.04
tpch_q07/datafusion:vortex-compact 68487898 69085095 0.99
tpch_q08/datafusion:vortex-compact 51690277 50246666 1.03
tpch_q09/datafusion:vortex-compact 61314672 59655721 1.03
tpch_q10/datafusion:vortex-compact 51685178 54585494 0.95
tpch_q11/datafusion:vortex-compact 18971358 19652695 0.97
tpch_q12/datafusion:vortex-compact 33961685 33711827 1.01
tpch_q13/datafusion:vortex-compact 36036325 36643996 0.98
tpch_q14/datafusion:vortex-compact 20161612 20615760 0.98
tpch_q15/datafusion:vortex-compact 33338701 35463289 0.94
tpch_q16/datafusion:vortex-compact 29859139 30037565 0.99
tpch_q17/datafusion:vortex-compact 68986599 70439502 0.98
tpch_q18/datafusion:vortex-compact 83815154 84660475 0.99
tpch_q19/datafusion:vortex-compact 39105497 39537457 0.99
tpch_q20/datafusion:vortex-compact 38044972 37766946 1.01
tpch_q21/datafusion:vortex-compact 86682581 85850619 1.01
tpch_q22/datafusion:vortex-compact 16805419 17351808 0.97
datafusion / parquet (1.023x ➖, 1↑ 4↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 136057248 92828006 1.47
tpch_q02/datafusion:parquet 68536424 68923718 0.99
tpch_q03/datafusion:parquet 🚨 80454786 72507478 1.11
tpch_q04/datafusion:parquet 47461822 47012131 1.01
tpch_q05/datafusion:parquet 101120365 101175617 1.00
tpch_q06/datafusion:parquet 41707317 41520653 1.00
tpch_q07/datafusion:parquet 109984193 110094723 1.00
tpch_q08/datafusion:parquet 🚨 106088845 96098285 1.10
tpch_q09/datafusion:parquet 130610651 133659604 0.98
tpch_q10/datafusion:parquet 122753172 120370378 1.02
tpch_q11/datafusion:parquet 48013444 47769930 1.01
tpch_q12/datafusion:parquet 80146214 82712964 0.97
tpch_q13/datafusion:parquet 202913806 202585082 1.00
tpch_q14/datafusion:parquet 🚀 44219278 51424279 0.86
tpch_q15/datafusion:parquet 63147700 63885855 0.99
tpch_q16/datafusion:parquet 50864028 49410426 1.03
tpch_q17/datafusion:parquet 127910256 139077852 0.92
tpch_q18/datafusion:parquet 164055498 165330820 0.99
tpch_q19/datafusion:parquet 🚨 80098267 69168988 1.16
tpch_q20/datafusion:parquet 74767556 76982411 0.97
tpch_q21/datafusion:parquet 147128833 145985180 1.01
tpch_q22/datafusion:parquet 36218281 35165269 1.03
datafusion / arrow (1.006x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 56886808 56989044 1.00
tpch_q02/datafusion:arrow 21184762 22057191 0.96
tpch_q03/datafusion:arrow 34048839 33163242 1.03
tpch_q04/datafusion:arrow 28138658 27699743 1.02
tpch_q05/datafusion:arrow 75580893 81398156 0.93
tpch_q06/datafusion:arrow 19801755 20705177 0.96
tpch_q07/datafusion:arrow 111881100 115040132 0.97
tpch_q08/datafusion:arrow 44341474 44925083 0.99
tpch_q09/datafusion:arrow 73759884 68847891 1.07
tpch_q10/datafusion:arrow 55137650 50682088 1.09
tpch_q11/datafusion:arrow 12002266 11239477 1.07
tpch_q12/datafusion:arrow 🚨 62448247 54199152 1.15
tpch_q13/datafusion:arrow 50323703 49724819 1.01
tpch_q14/datafusion:arrow 23077460 22747344 1.01
tpch_q15/datafusion:arrow 44134089 44581546 0.99
tpch_q16/datafusion:arrow 20928785 20510114 1.02
tpch_q17/datafusion:arrow 72423122 71030893 1.02
tpch_q18/datafusion:arrow 142240343 144185200 0.99
tpch_q19/datafusion:arrow 38547899 41742472 0.92
tpch_q20/datafusion:arrow 37916260 39300800 0.96
tpch_q21/datafusion:arrow 151589495 150386536 1.01
tpch_q22/datafusion:arrow 19572971 19798898 0.99
duckdb / vortex-file-compressed (1.002x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 32246389 33269308 0.97
tpch_q02/duckdb:vortex-file-compressed 27812153 27466822 1.01
tpch_q03/duckdb:vortex-file-compressed 30130567 29209694 1.03
tpch_q04/duckdb:vortex-file-compressed 29309972 29538686 0.99
tpch_q05/duckdb:vortex-file-compressed 31795988 32016573 0.99
tpch_q06/duckdb:vortex-file-compressed 10343639 10550738 0.98
tpch_q07/duckdb:vortex-file-compressed 37912270 35906520 1.06
tpch_q08/duckdb:vortex-file-compressed 42031377 39274976 1.07
tpch_q09/duckdb:vortex-file-compressed 78890146 76699604 1.03
tpch_q10/duckdb:vortex-file-compressed 36158238 35724211 1.01
tpch_q11/duckdb:vortex-file-compressed 16164374 16265690 0.99
tpch_q12/duckdb:vortex-file-compressed 23394283 23538117 0.99
tpch_q13/duckdb:vortex-file-compressed 37911664 38153186 0.99
tpch_q14/duckdb:vortex-file-compressed 21021023 21507435 0.98
tpch_q15/duckdb:vortex-file-compressed 15961727 16051281 0.99
tpch_q16/duckdb:vortex-file-compressed 30174349 30573235 0.99
tpch_q17/duckdb:vortex-file-compressed 25411155 24860223 1.02
tpch_q18/duckdb:vortex-file-compressed 47512527 49285086 0.96
tpch_q19/duckdb:vortex-file-compressed 32120816 31781468 1.01
tpch_q20/duckdb:vortex-file-compressed 34083459 34381064 0.99
tpch_q21/duckdb:vortex-file-compressed 99785071 102033782 0.98
tpch_q22/duckdb:vortex-file-compressed 18550255 18369612 1.01
duckdb / vortex-compact (1.011x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 40337353 38106717 1.06
tpch_q02/duckdb:vortex-compact 36527198 36974944 0.99
tpch_q03/duckdb:vortex-compact 31570923 31642776 1.00
tpch_q04/duckdb:vortex-compact 35377679 33637429 1.05
tpch_q05/duckdb:vortex-compact 38442229 37991862 1.01
tpch_q06/duckdb:vortex-compact 14778485 14878490 0.99
tpch_q07/duckdb:vortex-compact 42332335 43060086 0.98
tpch_q08/duckdb:vortex-compact 45923071 46395765 0.99
tpch_q09/duckdb:vortex-compact 91762219 85320519 1.08
tpch_q10/duckdb:vortex-compact 40667630 40961251 0.99
tpch_q11/duckdb:vortex-compact 20008367 20718360 0.97
tpch_q12/duckdb:vortex-compact 36927126 37125341 0.99
tpch_q13/duckdb:vortex-compact 47674429 45797725 1.04
tpch_q14/duckdb:vortex-compact 31282021 29613458 1.06
tpch_q15/duckdb:vortex-compact 19393203 19297484 1.00
tpch_q16/duckdb:vortex-compact 37140846 36060441 1.03
tpch_q17/duckdb:vortex-compact 31169957 31572306 0.99
tpch_q18/duckdb:vortex-compact 51462104 49895319 1.03
tpch_q19/duckdb:vortex-compact 37821117 38311432 0.99
tpch_q20/duckdb:vortex-compact 45487767 44863050 1.01
tpch_q21/duckdb:vortex-compact 110132885 111333980 0.99
tpch_q22/duckdb:vortex-compact 20768020 20504784 1.01
duckdb / parquet (1.035x ➖, 2↑ 5↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 75907692 79245046 0.96
tpch_q02/duckdb:parquet 38760736 39563682 0.98
tpch_q03/duckdb:parquet 🚨 83351790 70716624 1.18
tpch_q04/duckdb:parquet 🚨 56673861 47452074 1.19
tpch_q05/duckdb:parquet 65722168 69485243 0.95
tpch_q06/duckdb:parquet 🚨 29375486 20261053 1.45
tpch_q07/duckdb:parquet 🚀 69442951 78868260 0.88
tpch_q08/duckdb:parquet 🚀 85767028 95767877 0.90
tpch_q09/duckdb:parquet 🚨 156292483 141318905 1.11
tpch_q10/duckdb:parquet 139212972 136361589 1.02
tpch_q11/duckdb:parquet 22494461 22507204 1.00
tpch_q12/duckdb:parquet 56830030 56131445 1.01
tpch_q13/duckdb:parquet 260291165 260628018 1.00
tpch_q14/duckdb:parquet 49350342 47331378 1.04
tpch_q15/duckdb:parquet 24146281 25041188 0.96
tpch_q16/duckdb:parquet 54254207 54055689 1.00
tpch_q17/duckdb:parquet 58266175 53816730 1.08
tpch_q18/duckdb:parquet 112130235 121524143 0.92
tpch_q19/duckdb:parquet 🚨 86610803 68452251 1.27
tpch_q20/duckdb:parquet 63834262 62487594 1.02
tpch_q21/duckdb:parquet 174300183 171069832 1.02
tpch_q22/duckdb:parquet 51276341 52235626 0.98
duckdb / duckdb (0.988x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 16032037 15938099 1.01
tpch_q02/duckdb:duckdb 12212598 11597330 1.05
tpch_q03/duckdb:duckdb 19188765 18733160 1.02
tpch_q04/duckdb:duckdb 18842999 19153158 0.98
tpch_q05/duckdb:duckdb 19512194 19647238 0.99
tpch_q06/duckdb:duckdb 5051774 5189391 0.97
tpch_q07/duckdb:duckdb 22467838 22740584 0.99
tpch_q08/duckdb:duckdb 20429257 20928493 0.98
tpch_q09/duckdb:duckdb 52164070 56601755 0.92
tpch_q10/duckdb:duckdb 41486265 44631164 0.93
tpch_q11/duckdb:duckdb 5636127 5460309 1.03
tpch_q12/duckdb:duckdb 13834797 13437153 1.03
tpch_q13/duckdb:duckdb 38196198 38289200 1.00
tpch_q14/duckdb:duckdb 16617350 17999132 0.92
tpch_q15/duckdb:duckdb 11539583 11820378 0.98
tpch_q16/duckdb:duckdb 22409360 22804996 0.98
tpch_q17/duckdb:duckdb 13412296 13419979 1.00
tpch_q18/duckdb:duckdb 38030862 37040120 1.03
tpch_q19/duckdb:duckdb 26065276 27197075 0.96
tpch_q20/duckdb:duckdb 22465219 23398561 0.96
tpch_q21/duckdb:duckdb 55316288 54930007 1.01
tpch_q22/duckdb:duckdb 24004169 23895232 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -0.2% +18.5% -15.8% +29.3% ➖ noise
1 datafusion:vortex-compact -5.6% +18.5% -20.3% +29.1% ➖ noise
1 datafusion:vortex-file-compressed +3.8% +18.5% -12.4% +29.5% ➖ noise
1 duckdb:duckdb +0.6% +18.5% -15.1% +26.8% ➖ noise
1 duckdb:vortex-compact +5.9% +18.5% -10.7% +26.5% ➖ noise
1 duckdb:vortex-file-compressed -3.1% +18.5% -18.2% +27.5% ➖ noise
2 datafusion:arrow -4.0% -1.3% -2.7% +21.8% ➖ noise
2 datafusion:vortex-compact -3.6% -1.3% -2.3% +21.8% ➖ noise
2 datafusion:vortex-file-compressed +1.1% -1.3% +2.4% +21.8% ➖ noise
2 duckdb:duckdb +5.3% -1.3% +6.7% +21.8% ➖ noise
2 duckdb:vortex-compact -1.2% -1.3% +0.1% +21.8% ➖ noise
2 duckdb:vortex-file-compressed +1.3% -1.3% +2.6% +21.8% ➖ noise
3 datafusion:arrow +2.7% +14.4% -10.2% +21.8% ➖ noise
3 datafusion:vortex-compact +0.8% +14.4% -11.9% +21.8% ➖ noise
3 datafusion:vortex-file-compressed +8.1% +14.4% -5.5% +21.8% ➖ noise
3 duckdb:duckdb +2.4% +14.4% -10.4% +21.8% ➖ noise
3 duckdb:vortex-compact -0.2% +14.4% -12.8% +21.8% ➖ noise
3 duckdb:vortex-file-compressed +3.2% +14.4% -9.8% +21.8% ➖ noise
4 datafusion:arrow +1.6% +9.8% -7.5% +21.8% ➖ noise
4 datafusion:vortex-compact -0.3% +9.8% -9.2% +21.8% ➖ noise
4 datafusion:vortex-file-compressed -1.7% +9.8% -10.4% +21.8% ➖ noise
4 duckdb:duckdb -1.6% +9.8% -10.4% +21.8% ➖ noise
4 duckdb:vortex-compact +5.2% +9.8% -4.2% +21.8% ➖ noise
4 duckdb:vortex-file-compressed -0.8% +9.8% -9.6% +21.8% ➖ noise
5 datafusion:arrow -7.1% -2.8% -4.5% +21.8% ➖ noise
5 datafusion:vortex-compact +4.4% -2.8% +7.3% +21.8% ➖ noise
5 datafusion:vortex-file-compressed -2.9% -2.8% -0.2% +21.8% ➖ noise
5 duckdb:duckdb -0.7% -2.8% +2.1% +21.8% ➖ noise
5 duckdb:vortex-compact +1.2% -2.8% +4.1% +21.8% ➖ noise
5 duckdb:vortex-file-compressed -0.7% -2.8% +2.1% +21.8% ➖ noise
6 datafusion:arrow -4.4% +20.7% -20.8% +24.6% ✅ faster
6 datafusion:vortex-compact +3.9% +20.7% -13.9% +26.4% ➖ noise
6 datafusion:vortex-file-compressed -1.2% +20.7% -18.1% +25.9% ➖ noise
6 duckdb:duckdb -2.7% +20.7% -19.3% +28.9% ➖ noise
6 duckdb:vortex-compact -0.7% +20.7% -17.7% +30.1% ➖ noise
6 duckdb:vortex-file-compressed -2.0% +20.7% -18.8% +25.3% ➖ noise
7 datafusion:arrow -2.7% -6.2% +3.7% +21.8% ➖ noise
7 datafusion:vortex-compact -0.9% -6.2% +5.7% +21.8% ➖ noise
7 datafusion:vortex-file-compressed +0.9% -6.2% +7.5% +21.8% ➖ noise
7 duckdb:duckdb -1.2% -6.2% +5.3% +21.8% ➖ noise
7 duckdb:vortex-compact -1.7% -6.2% +4.8% +21.8% ➖ noise
7 duckdb:vortex-file-compressed +5.6% -6.2% +12.6% +21.8% ➖ noise
8 datafusion:arrow -1.3% -0.6% -0.7% +21.8% ➖ noise
8 datafusion:vortex-compact +2.9% -0.6% +3.5% +21.8% ➖ noise
8 datafusion:vortex-file-compressed +2.4% -0.6% +3.0% +21.8% ➖ noise
8 duckdb:duckdb -2.4% -0.6% -1.8% +21.8% ➖ noise
8 duckdb:vortex-compact -1.0% -0.6% -0.5% +21.8% ➖ noise
8 duckdb:vortex-file-compressed +7.0% -0.6% +7.6% +21.8% ➖ noise
9 datafusion:arrow +7.1% +4.0% +3.1% +21.8% ➖ noise
9 datafusion:vortex-compact +2.8% +4.0% -1.1% +21.8% ➖ noise
9 datafusion:vortex-file-compressed -0.7% +4.0% -4.5% +21.8% ➖ noise
9 duckdb:duckdb -7.8% +4.0% -11.3% +21.8% ➖ noise
9 duckdb:vortex-compact +7.6% +4.0% +3.5% +21.8% ➖ noise
9 duckdb:vortex-file-compressed +2.9% +4.0% -1.1% +21.8% ➖ noise
10 datafusion:arrow +8.8% +2.0% +6.6% +21.8% ➖ noise
10 datafusion:vortex-compact -5.3% +2.0% -7.2% +21.8% ➖ noise
10 datafusion:vortex-file-compressed -0.2% +2.0% -2.2% +21.8% ➖ noise
10 duckdb:duckdb -7.0% +2.0% -8.9% +21.8% ➖ noise
10 duckdb:vortex-compact -0.7% +2.0% -2.7% +21.8% ➖ noise
10 duckdb:vortex-file-compressed +1.2% +2.0% -0.8% +21.8% ➖ noise
11 datafusion:arrow +6.8% +0.2% +6.5% +24.5% ➖ noise
11 datafusion:vortex-compact -3.5% +0.2% -3.7% +21.8% ➖ noise
11 datafusion:vortex-file-compressed +1.4% +0.2% +1.2% +21.8% ➖ noise
11 duckdb:duckdb +3.2% +0.2% +3.0% +21.8% ➖ noise
11 duckdb:vortex-compact -3.4% +0.2% -3.6% +21.8% ➖ noise
11 duckdb:vortex-file-compressed -0.6% +0.2% -0.8% +21.8% ➖ noise
12 datafusion:arrow +15.2% -1.0% +16.3% +21.8% ➖ noise
12 datafusion:vortex-compact +0.7% -1.0% +1.7% +21.8% ➖ noise
12 datafusion:vortex-file-compressed -4.8% -1.0% -3.9% +21.8% ➖ noise
12 duckdb:duckdb +3.0% -1.0% +4.0% +21.8% ➖ noise
12 duckdb:vortex-compact -0.5% -1.0% +0.4% +21.8% ➖ noise
12 duckdb:vortex-file-compressed -0.6% -1.0% +0.3% +21.8% ➖ noise
13 datafusion:arrow +1.2% +0.0% +1.2% +21.8% ➖ noise
13 datafusion:vortex-compact -1.7% +0.0% -1.7% +21.8% ➖ noise
13 datafusion:vortex-file-compressed -0.5% +0.0% -0.5% +21.8% ➖ noise
13 duckdb:duckdb -0.2% +0.0% -0.3% +21.8% ➖ noise
13 duckdb:vortex-compact +4.1% +0.0% +4.1% +21.8% ➖ noise
13 duckdb:vortex-file-compressed -0.6% +0.0% -0.6% +21.8% ➖ noise
14 datafusion:arrow +1.5% -5.3% +7.1% +21.8% ➖ noise
14 datafusion:vortex-compact -2.2% -5.3% +3.3% +21.8% ➖ noise
14 datafusion:vortex-file-compressed -1.7% -5.3% +3.8% +21.8% ➖ noise
14 duckdb:duckdb -7.7% -5.3% -2.5% +22.8% ➖ noise
14 duckdb:vortex-compact +5.6% -5.3% +11.6% +21.8% ➖ noise
14 duckdb:vortex-file-compressed -2.3% -5.3% +3.2% +21.8% ➖ noise
15 datafusion:arrow -1.0% -2.4% +1.4% +21.8% ➖ noise
15 datafusion:vortex-compact -6.0% -2.4% -3.7% +21.8% ➖ noise
15 datafusion:vortex-file-compressed -7.0% -2.4% -4.8% +21.8% ➖ noise
15 duckdb:duckdb -2.4% -2.4% -0.0% +21.8% ➖ noise
15 duckdb:vortex-compact +0.5% -2.4% +2.9% +21.8% ➖ noise
15 duckdb:vortex-file-compressed -0.6% -2.4% +1.9% +21.8% ➖ noise
16 datafusion:arrow +2.0% +1.6% +0.4% +21.8% ➖ noise
16 datafusion:vortex-compact -0.6% +1.6% -2.2% +21.8% ➖ noise
16 datafusion:vortex-file-compressed +2.2% +1.6% +0.6% +21.8% ➖ noise
16 duckdb:duckdb -1.7% +1.6% -3.3% +21.8% ➖ noise
16 duckdb:vortex-compact +3.0% +1.6% +1.3% +21.8% ➖ noise
16 duckdb:vortex-file-compressed -1.3% +1.6% -2.9% +21.8% ➖ noise
17 datafusion:arrow +2.0% -0.2% +2.2% +21.8% ➖ noise
17 datafusion:vortex-compact -2.1% -0.2% -1.9% +21.8% ➖ noise
17 datafusion:vortex-file-compressed +7.7% -0.2% +7.9% +21.8% ➖ noise
17 duckdb:duckdb -0.1% -0.2% +0.2% +21.8% ➖ noise
17 duckdb:vortex-compact -1.3% -0.2% -1.1% +21.8% ➖ noise
17 duckdb:vortex-file-compressed +2.2% -0.2% +2.4% +21.8% ➖ noise
18 datafusion:arrow -1.3% -4.3% +3.1% +21.8% ➖ noise
18 datafusion:vortex-compact -1.0% -4.3% +3.5% +21.8% ➖ noise
18 datafusion:vortex-file-compressed +0.1% -4.3% +4.6% +21.8% ➖ noise
18 duckdb:duckdb +2.7% -4.3% +7.3% +21.8% ➖ noise
18 duckdb:vortex-compact +3.1% -4.3% +7.8% +21.8% ➖ noise
18 duckdb:vortex-file-compressed -3.6% -4.3% +0.7% +21.8% ➖ noise
19 datafusion:arrow -7.7% +21.0% -23.7% +21.8% ✅ faster
19 datafusion:vortex-compact -1.1% +21.0% -18.3% +21.8% ✅ faster
19 datafusion:vortex-file-compressed -3.1% +21.0% -20.0% +24.8% ✅ faster
19 duckdb:duckdb -4.2% +21.0% -20.8% +22.7% ✅ faster
19 duckdb:vortex-compact -1.3% +21.0% -18.4% +21.8% ✅ faster
19 duckdb:vortex-file-compressed +1.1% +21.0% -16.5% +21.8% ➖ noise
20 datafusion:arrow -3.5% -0.4% -3.1% +21.8% ➖ noise
20 datafusion:vortex-compact +0.7% -0.4% +1.1% +21.8% ➖ noise
20 datafusion:vortex-file-compressed +1.0% -0.4% +1.4% +21.8% ➖ noise
20 duckdb:duckdb -4.0% -0.4% -3.6% +21.8% ➖ noise
20 duckdb:vortex-compact +1.4% -0.4% +1.8% +21.8% ➖ noise
20 duckdb:vortex-file-compressed -0.9% -0.4% -0.5% +21.8% ➖ noise
21 datafusion:arrow +0.8% +1.3% -0.5% +21.8% ➖ noise
21 datafusion:vortex-compact +1.0% +1.3% -0.4% +21.8% ➖ noise
21 datafusion:vortex-file-compressed -2.4% +1.3% -3.7% +21.8% ➖ noise
21 duckdb:duckdb +0.7% +1.3% -0.6% +21.8% ➖ noise
21 duckdb:vortex-compact -1.1% +1.3% -2.4% +21.8% ➖ noise
21 duckdb:vortex-file-compressed -2.2% +1.3% -3.5% +21.8% ➖ noise
22 datafusion:arrow -1.1% +0.5% -1.7% +21.8% ➖ noise
22 datafusion:vortex-compact -3.1% +0.5% -3.7% +21.8% ➖ noise
22 datafusion:vortex-file-compressed -2.0% +0.5% -2.5% +21.8% ➖ noise
22 duckdb:duckdb +0.5% +0.5% -0.1% +21.8% ➖ noise
22 duckdb:vortex-compact +1.3% +0.5% +0.7% +21.8% ➖ noise
22 duckdb:vortex-file-compressed +1.0% +0.5% +0.4% +21.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Vortex (geomean): 1.016x ➖
Parquet (geomean): 1.015x ➖
Shifts: Parquet (control) +1.5% · Median polish +2.5%

datafusion / vortex-file-compressed (0.949x ➖, 2↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5870507 5468883 1.07
fineweb_q01/datafusion:vortex-file-compressed 28665528 29218276 0.98
fineweb_q02/datafusion:vortex-file-compressed 28166031 29618423 0.95
fineweb_q03/datafusion:vortex-file-compressed 🚀 70023027 85460944 0.82
fineweb_q04/datafusion:vortex-file-compressed 262824453 257638369 1.02
fineweb_q05/datafusion:vortex-file-compressed 240539902 232685523 1.03
fineweb_q06/datafusion:vortex-file-compressed 68289249 69988303 0.98
fineweb_q07/datafusion:vortex-file-compressed 68688552 74198218 0.93
fineweb_q08/datafusion:vortex-file-compressed 🚀 25514107 31883020 0.80
datafusion / vortex-compact (1.053x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 5647513 5305770 1.06
fineweb_q01/datafusion:vortex-compact 167726417 163733743 1.02
fineweb_q02/datafusion:vortex-compact 171228038 165953466 1.03
fineweb_q03/datafusion:vortex-compact 1512319869 1464488217 1.03
fineweb_q04/datafusion:vortex-compact 1647458798 1578124180 1.04
fineweb_q05/datafusion:vortex-compact 1281722129 1231968923 1.04
fineweb_q06/datafusion:vortex-compact 723368112 703951526 1.03
fineweb_q07/datafusion:vortex-compact 762983737 738211582 1.03
fineweb_q08/datafusion:vortex-compact 🚨 24594884 20763906 1.18
datafusion / parquet (1.010x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 6977034 7150984 0.98
fineweb_q01/datafusion:parquet 288135295 284698277 1.01
fineweb_q02/datafusion:parquet 286410362 286233477 1.00
fineweb_q03/datafusion:parquet 287939634 279944650 1.03
fineweb_q04/datafusion:parquet 307847454 295246377 1.04
fineweb_q05/datafusion:parquet 307436078 287526085 1.07
fineweb_q06/datafusion:parquet 293855165 302189965 0.97
fineweb_q07/datafusion:parquet 289445107 291301668 0.99
fineweb_q08/datafusion:parquet 281567253 281468523 1.00
duckdb / vortex-file-compressed (1.031x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3824800 3483380 1.10
fineweb_q01/duckdb:vortex-file-compressed 30651787 29316281 1.05
fineweb_q02/duckdb:vortex-file-compressed 28190462 27366120 1.03
fineweb_q03/duckdb:vortex-file-compressed 162432344 164845631 0.99
fineweb_q04/duckdb:vortex-file-compressed 232174621 228370867 1.02
fineweb_q05/duckdb:vortex-file-compressed 224306890 221109764 1.01
fineweb_q06/duckdb:vortex-file-compressed 65941073 68922473 0.96
fineweb_q07/duckdb:vortex-file-compressed 71236424 68332465 1.04
fineweb_q08/duckdb:vortex-file-compressed 27144936 24740525 1.10
duckdb / vortex-compact (1.036x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4431225 4165350 1.06
fineweb_q01/duckdb:vortex-compact 🚨 111116202 97023852 1.15
fineweb_q02/duckdb:vortex-compact 120900384 119934690 1.01
fineweb_q03/duckdb:vortex-compact 909745295 888384611 1.02
fineweb_q04/duckdb:vortex-compact 956448480 928108742 1.03
fineweb_q05/duckdb:vortex-compact 865484682 824156992 1.05
fineweb_q06/duckdb:vortex-compact 486334993 476682919 1.02
fineweb_q07/duckdb:vortex-compact 499515797 480526521 1.04
fineweb_q08/duckdb:vortex-compact 23424771 24517158 0.96
duckdb / parquet (1.019x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 37672271 39076860 0.96
fineweb_q01/duckdb:parquet 98393714 96216428 1.02
fineweb_q02/duckdb:parquet 102709588 101764390 1.01
fineweb_q03/duckdb:parquet 325559232 314990878 1.03
fineweb_q04/duckdb:parquet 450639192 444293824 1.01
fineweb_q05/duckdb:parquet 422703752 416292407 1.02
fineweb_q06/duckdb:parquet 207544150 201746704 1.03
fineweb_q07/duckdb:parquet 219313743 213963310 1.03
fineweb_q08/duckdb:parquet 61621891 58151495 1.06
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +6.4% -3.0% +9.8% +35.9% ➖ noise
0 datafusion:vortex-file-compressed +7.3% -3.0% +10.7% +55.8% ➖ noise
0 duckdb:vortex-compact +6.4% -3.0% +9.7% +32.3% ➖ noise
0 duckdb:vortex-file-compressed +9.8% -3.0% +13.2% +52.0% ➖ noise
1 datafusion:vortex-compact +2.4% +1.7% +0.7% +10.0% ➖ noise
1 datafusion:vortex-file-compressed -1.9% +1.7% -3.6% +23.2% ➖ noise
1 duckdb:vortex-compact +14.5% +1.7% +12.6% +15.2% ➖ noise
1 duckdb:vortex-file-compressed +4.6% +1.7% +2.8% +41.3% ➖ noise
2 datafusion:vortex-compact +3.2% +0.5% +2.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -4.9% +0.5% -5.4% +15.2% ➖ noise
2 duckdb:vortex-compact +0.8% +0.5% +0.3% +12.0% ➖ noise
2 duckdb:vortex-file-compressed +3.0% +0.5% +2.5% +10.0% ➖ noise
3 datafusion:vortex-compact +3.3% +3.1% +0.2% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -18.1% +3.1% -20.5% +36.1% ➖ noise
3 duckdb:vortex-compact +2.4% +3.1% -0.7% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -1.5% +3.1% -4.4% +22.1% ➖ noise
4 datafusion:vortex-compact +4.4% +2.8% +1.5% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.0% +2.8% -0.8% +10.0% ➖ noise
4 duckdb:vortex-compact +3.1% +2.8% +0.2% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +1.7% +2.8% -1.1% +10.0% ➖ noise
5 datafusion:vortex-compact +4.0% +4.2% -0.2% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +3.4% +4.2% -0.8% +10.0% ➖ noise
5 duckdb:vortex-compact +5.0% +4.2% +0.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +1.4% +4.2% -2.6% +10.0% ➖ noise
6 datafusion:vortex-compact +2.8% +0.0% +2.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -2.4% +0.0% -2.4% +13.3% ➖ noise
6 duckdb:vortex-compact +2.0% +0.0% +2.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -4.3% +0.0% -4.3% +13.5% ➖ noise
7 datafusion:vortex-compact +3.4% +0.9% +2.4% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -7.4% +0.9% -8.3% +26.3% ➖ noise
7 duckdb:vortex-compact +4.0% +0.9% +3.0% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +4.2% +0.9% +3.3% +26.5% ➖ noise
8 datafusion:vortex-compact +18.5% +3.0% +15.0% +20.8% ➖ noise
8 datafusion:vortex-file-compressed -20.0% +3.0% -22.3% +27.7% ✅ faster
8 duckdb:vortex-compact -4.5% +3.0% -7.2% +17.9% ➖ noise
8 duckdb:vortex-file-compressed +9.7% +3.0% +6.6% +19.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Vortex (geomean): 1.036x ➖
Parquet (geomean): 1.050x ➖
Shifts: Parquet (control) +5.0% · Median polish +1.8%

datafusion / vortex-file-compressed (1.084x ➖, 0↑ 29↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 🚨 31689605 28787738 1.10
tpcds_q02/datafusion:vortex-file-compressed 58545386 54210832 1.08
tpcds_q03/datafusion:vortex-file-compressed 22278255 20306172 1.10
tpcds_q04/datafusion:vortex-file-compressed 325262735 297196524 1.09
tpcds_q05/datafusion:vortex-file-compressed 🚨 60537100 54800287 1.10
tpcds_q06/datafusion:vortex-file-compressed 56670859 52569814 1.08
tpcds_q07/datafusion:vortex-file-compressed 🚨 57040174 51328881 1.11
tpcds_q08/datafusion:vortex-file-compressed 🚨 41463708 37339148 1.11
tpcds_q09/datafusion:vortex-file-compressed 59035195 54988191 1.07
tpcds_q10/datafusion:vortex-file-compressed 50322790 46954898 1.07
tpcds_q11/datafusion:vortex-file-compressed 🚨 185526114 167979376 1.10
tpcds_q12/datafusion:vortex-file-compressed 24721511 23519322 1.05
tpcds_q13/datafusion:vortex-file-compressed 63550720 61806347 1.03
tpcds_q14/datafusion:vortex-file-compressed 221047150 201453954 1.10
tpcds_q15/datafusion:vortex-file-compressed 🚨 39775638 34683365 1.15
tpcds_q16/datafusion:vortex-file-compressed 🚨 31825091 28626852 1.11
tpcds_q17/datafusion:vortex-file-compressed 74036713 68092905 1.09
tpcds_q18/datafusion:vortex-file-compressed 87590255 80750929 1.08
tpcds_q19/datafusion:vortex-file-compressed 34051885 32655489 1.04
tpcds_q20/datafusion:vortex-file-compressed 29124871 26623740 1.09
tpcds_q21/datafusion:vortex-file-compressed 🚨 150321341 133273941 1.13
tpcds_q22/datafusion:vortex-file-compressed 🚨 63372087 57003620 1.11
tpcds_q23/datafusion:vortex-file-compressed 167386755 152453968 1.10
tpcds_q24/datafusion:vortex-file-compressed 🚨 130763201 113066835 1.16
tpcds_q25/datafusion:vortex-file-compressed 🚨 78580177 67920496 1.16
tpcds_q26/datafusion:vortex-file-compressed 🚨 44081644 36677606 1.20
tpcds_q27/datafusion:vortex-file-compressed 🚨 138812579 118951686 1.17
tpcds_q28/datafusion:vortex-file-compressed 54326760 49666700 1.09
tpcds_q29/datafusion:vortex-file-compressed 74564455 68275511 1.09
tpcds_q30/datafusion:vortex-file-compressed 🚨 34653669 30938715 1.12
tpcds_q31/datafusion:vortex-file-compressed 🚨 108068754 96597567 1.12
tpcds_q32/datafusion:vortex-file-compressed 🚨 24703122 21389841 1.15
tpcds_q33/datafusion:vortex-file-compressed 42805528 39588310 1.08
tpcds_q34/datafusion:vortex-file-compressed 🚨 36598804 32999455 1.11
tpcds_q35/datafusion:vortex-file-compressed 63483564 58780823 1.08
tpcds_q36/datafusion:vortex-file-compressed 81952430 76273227 1.07
tpcds_q37/datafusion:vortex-file-compressed 36583445 34690762 1.05
tpcds_q38/datafusion:vortex-file-compressed 56570131 51941404 1.09
tpcds_q39/datafusion:vortex-file-compressed 145527588 151754700 0.96
tpcds_q40/datafusion:vortex-file-compressed 55478845 53029872 1.05
tpcds_q41/datafusion:vortex-file-compressed 🚨 21139525 17664718 1.20
tpcds_q42/datafusion:vortex-file-compressed 20192939 19391981 1.04
tpcds_q43/datafusion:vortex-file-compressed 34841455 32412199 1.07
tpcds_q44/datafusion:vortex-file-compressed 46012860 43457320 1.06
tpcds_q45/datafusion:vortex-file-compressed 🚨 37949278 34404267 1.10
tpcds_q46/datafusion:vortex-file-compressed 🚨 52955018 47168037 1.12
tpcds_q47/datafusion:vortex-file-compressed 🚨 223445173 202610163 1.10
tpcds_q48/datafusion:vortex-file-compressed 53020754 48728647 1.09
tpcds_q49/datafusion:vortex-file-compressed 76169797 72127390 1.06
tpcds_q50/datafusion:vortex-file-compressed 🚨 50261597 45635842 1.10
tpcds_q51/datafusion:vortex-file-compressed 95175182 90318118 1.05
tpcds_q52/datafusion:vortex-file-compressed 🚨 20920575 18242769 1.15
tpcds_q53/datafusion:vortex-file-compressed 28024068 26186932 1.07
tpcds_q54/datafusion:vortex-file-compressed 47887562 47285232 1.01
tpcds_q55/datafusion:vortex-file-compressed 19956067 18787341 1.06
tpcds_q56/datafusion:vortex-file-compressed 44771725 40851267 1.10
tpcds_q57/datafusion:vortex-file-compressed 136643398 127245600 1.07
tpcds_q58/datafusion:vortex-file-compressed 74798710 68738103 1.09
tpcds_q59/datafusion:vortex-file-compressed 76900427 73040996 1.05
tpcds_q60/datafusion:vortex-file-compressed 43950472 40824380 1.08
tpcds_q61/datafusion:vortex-file-compressed 55159771 51681217 1.07
tpcds_q62/datafusion:vortex-file-compressed 33848729 31076669 1.09
tpcds_q63/datafusion:vortex-file-compressed 28436450 26018931 1.09
tpcds_q64/datafusion:vortex-file-compressed 510853290 481754874 1.06
tpcds_q65/datafusion:vortex-file-compressed 51966046 48317196 1.08
tpcds_q66/datafusion:vortex-file-compressed 97508401 94811627 1.03
tpcds_q67/datafusion:vortex-file-compressed 127175271 116021528 1.10
tpcds_q68/datafusion:vortex-file-compressed 🚨 51986775 45604885 1.14
tpcds_q69/datafusion:vortex-file-compressed 47546048 44351472 1.07
tpcds_q70/datafusion:vortex-file-compressed 119785541 111204814 1.08
tpcds_q71/datafusion:vortex-file-compressed 32784844 31635547 1.04
tpcds_q72/datafusion:vortex-file-compressed 2849248992 2619743685 1.09
tpcds_q73/datafusion:vortex-file-compressed 38515877 37386171 1.03
tpcds_q74/datafusion:vortex-file-compressed 126962928 117586237 1.08
tpcds_q75/datafusion:vortex-file-compressed 128339805 119143067 1.08
tpcds_q76/datafusion:vortex-file-compressed 🚨 38822543 34731447 1.12
tpcds_q77/datafusion:vortex-file-compressed 56105931 53447748 1.05
tpcds_q78/datafusion:vortex-file-compressed 136582336 125900310 1.08
tpcds_q79/datafusion:vortex-file-compressed 🚨 43896119 39631205 1.11
tpcds_q80/datafusion:vortex-file-compressed 124932446 114790493 1.09
tpcds_q81/datafusion:vortex-file-compressed 🚨 40566169 36707698 1.11
tpcds_q82/datafusion:vortex-file-compressed 39072349 36898760 1.06
tpcds_q83/datafusion:vortex-file-compressed 54007667 52147765 1.04
tpcds_q84/datafusion:vortex-file-compressed 17243627 15702031 1.10
tpcds_q85/datafusion:vortex-file-compressed 108132803 101022683 1.07
tpcds_q86/datafusion:vortex-file-compressed 20276006 18630372 1.09
tpcds_q87/datafusion:vortex-file-compressed 55770949 55073092 1.01
tpcds_q88/datafusion:vortex-file-compressed 84318753 78709967 1.07
tpcds_q89/datafusion:vortex-file-compressed 39382456 37497827 1.05
tpcds_q90/datafusion:vortex-file-compressed 19659252 18958891 1.04
tpcds_q91/datafusion:vortex-file-compressed 28836251 26454776 1.09
tpcds_q92/datafusion:vortex-file-compressed 🚨 20721729 18591760 1.11
tpcds_q93/datafusion:vortex-file-compressed 🚨 37791145 34231420 1.10
tpcds_q94/datafusion:vortex-file-compressed 26416708 24512449 1.08
tpcds_q95/datafusion:vortex-file-compressed 64020278 60416104 1.06
tpcds_q96/datafusion:vortex-file-compressed 18313803 17249522 1.06
tpcds_q97/datafusion:vortex-file-compressed 32692683 31901231 1.02
tpcds_q98/datafusion:vortex-file-compressed 35314219 33048056 1.07
tpcds_q99/datafusion:vortex-file-compressed 48841958 47990133 1.02
datafusion / vortex-compact (1.049x ➖, 0↑ 5↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 39192320 36717739 1.07
tpcds_q02/datafusion:vortex-compact 61654698 58357088 1.06
tpcds_q03/datafusion:vortex-compact 27475027 25352799 1.08
tpcds_q04/datafusion:vortex-compact 352066263 330959691 1.06
tpcds_q05/datafusion:vortex-compact 72035476 67156622 1.07
tpcds_q06/datafusion:vortex-compact 60726068 56587825 1.07
tpcds_q07/datafusion:vortex-compact 70988362 66319631 1.07
tpcds_q08/datafusion:vortex-compact 49003281 48069392 1.02
tpcds_q09/datafusion:vortex-compact 107919382 106158807 1.02
tpcds_q10/datafusion:vortex-compact 67182403 64781628 1.04
tpcds_q11/datafusion:vortex-compact 200322921 187439561 1.07
tpcds_q12/datafusion:vortex-compact 27474702 26167806 1.05
tpcds_q13/datafusion:vortex-compact 134146423 128310767 1.05
tpcds_q14/datafusion:vortex-compact 267577070 254464724 1.05
tpcds_q15/datafusion:vortex-compact 41785421 39886221 1.05
tpcds_q16/datafusion:vortex-compact 39982098 40583053 0.99
tpcds_q17/datafusion:vortex-compact 99637181 94374593 1.06
tpcds_q18/datafusion:vortex-compact 100023410 97227092 1.03
tpcds_q19/datafusion:vortex-compact 47310976 45035501 1.05
tpcds_q20/datafusion:vortex-compact 32415392 30871223 1.05
tpcds_q21/datafusion:vortex-compact 152234001 140707275 1.08
tpcds_q22/datafusion:vortex-compact 68311588 68014219 1.00
tpcds_q23/datafusion:vortex-compact 195345837 184044436 1.06
tpcds_q24/datafusion:vortex-compact 152586566 142598592 1.07
tpcds_q25/datafusion:vortex-compact 99194881 96339493 1.03
tpcds_q26/datafusion:vortex-compact 51419893 49090183 1.05
tpcds_q27/datafusion:vortex-compact 168990615 162974124 1.04
tpcds_q28/datafusion:vortex-compact 106826800 100280345 1.07
tpcds_q29/datafusion:vortex-compact 101005017 95218014 1.06
tpcds_q30/datafusion:vortex-compact 39845205 36752183 1.08
tpcds_q31/datafusion:vortex-compact 135392617 125029903 1.08
tpcds_q32/datafusion:vortex-compact 🚨 29313124 26601318 1.10
tpcds_q33/datafusion:vortex-compact 56077584 53966906 1.04
tpcds_q34/datafusion:vortex-compact 52732480 49059682 1.07
tpcds_q35/datafusion:vortex-compact 73337103 70762954 1.04
tpcds_q36/datafusion:vortex-compact 107543276 103008548 1.04
tpcds_q37/datafusion:vortex-compact 49415078 51268171 0.96
tpcds_q38/datafusion:vortex-compact 70220052 68336829 1.03
tpcds_q39/datafusion:vortex-compact 156121185 154904389 1.01
tpcds_q40/datafusion:vortex-compact 62907906 59015304 1.07
tpcds_q41/datafusion:vortex-compact 24532644 22361753 1.10
tpcds_q42/datafusion:vortex-compact 26150333 25286373 1.03
tpcds_q43/datafusion:vortex-compact 43238714 39317286 1.10
tpcds_q44/datafusion:vortex-compact 80147878 74225622 1.08
tpcds_q45/datafusion:vortex-compact 39675417 38285247 1.04
tpcds_q46/datafusion:vortex-compact 76140140 71171980 1.07
tpcds_q47/datafusion:vortex-compact 246803068 228616070 1.08
tpcds_q48/datafusion:vortex-compact 104789767 100031300 1.05
tpcds_q49/datafusion:vortex-compact 99645550 98389223 1.01
tpcds_q50/datafusion:vortex-compact 67848313 64099087 1.06
tpcds_q51/datafusion:vortex-compact 104318875 96693548 1.08
tpcds_q52/datafusion:vortex-compact 27258161 25894091 1.05
tpcds_q53/datafusion:vortex-compact 🚨 39344560 35509848 1.11
tpcds_q54/datafusion:vortex-compact 61748508 58915097 1.05
tpcds_q55/datafusion:vortex-compact 🚨 26828435 24376959 1.10
tpcds_q56/datafusion:vortex-compact 58644712 55484346 1.06
tpcds_q57/datafusion:vortex-compact 🚨 155564702 141406718 1.10
tpcds_q58/datafusion:vortex-compact 84146801 77627338 1.08
tpcds_q59/datafusion:vortex-compact 92722600 87031010 1.07
tpcds_q60/datafusion:vortex-compact 58520749 56597012 1.03
tpcds_q61/datafusion:vortex-compact 78936069 75358083 1.05
tpcds_q62/datafusion:vortex-compact 35006999 33032285 1.06
tpcds_q63/datafusion:vortex-compact 36441344 35623759 1.02
tpcds_q64/datafusion:vortex-compact 576213643 546841667 1.05
tpcds_q65/datafusion:vortex-compact 73322033 68242053 1.07
tpcds_q66/datafusion:vortex-compact 108847241 101047832 1.08
tpcds_q67/datafusion:vortex-compact 134358134 128656250 1.04
tpcds_q68/datafusion:vortex-compact 74889621 69164920 1.08
tpcds_q69/datafusion:vortex-compact 64685406 60592909 1.07
tpcds_q70/datafusion:vortex-compact 135438392 128543196 1.05
tpcds_q71/datafusion:vortex-compact 47475698 47470988 1.00
tpcds_q72/datafusion:vortex-compact 2789247101 2660260913 1.05
tpcds_q73/datafusion:vortex-compact 52124063 50870120 1.02
tpcds_q74/datafusion:vortex-compact 139452188 132373107 1.05
tpcds_q75/datafusion:vortex-compact 171168417 168220973 1.02
tpcds_q76/datafusion:vortex-compact 54608900 52166001 1.05
tpcds_q77/datafusion:vortex-compact 69104765 66129978 1.04
tpcds_q78/datafusion:vortex-compact 156056118 149629927 1.04
tpcds_q79/datafusion:vortex-compact 62338043 60750737 1.03
tpcds_q80/datafusion:vortex-compact 138184405 134325070 1.03
tpcds_q81/datafusion:vortex-compact 45928110 42712651 1.08
tpcds_q82/datafusion:vortex-compact 50872346 49530836 1.03
tpcds_q83/datafusion:vortex-compact 62292877 59528348 1.05
tpcds_q84/datafusion:vortex-compact 19589728 19055622 1.03
tpcds_q85/datafusion:vortex-compact 127555410 124646597 1.02
tpcds_q86/datafusion:vortex-compact 🚨 21764781 19721539 1.10
tpcds_q87/datafusion:vortex-compact 69306816 66271399 1.05
tpcds_q88/datafusion:vortex-compact 141856581 139440109 1.02
tpcds_q89/datafusion:vortex-compact 47264535 47313279 1.00
tpcds_q90/datafusion:vortex-compact 25147601 24302606 1.03
tpcds_q91/datafusion:vortex-compact 42146619 41824107 1.01
tpcds_q92/datafusion:vortex-compact 22389737 21235617 1.05
tpcds_q93/datafusion:vortex-compact 49455613 47231872 1.05
tpcds_q94/datafusion:vortex-compact 32191364 31840570 1.01
tpcds_q95/datafusion:vortex-compact 71643466 73105836 0.98
tpcds_q96/datafusion:vortex-compact 28101604 27180423 1.03
tpcds_q97/datafusion:vortex-compact 43370786 41528940 1.04
tpcds_q98/datafusion:vortex-compact 39725998 37571114 1.06
tpcds_q99/datafusion:vortex-compact 50884190 50740743 1.00
datafusion / parquet (1.084x ➖, 0↑ 38↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 39242942 37477171 1.05
tpcds_q02/datafusion:parquet 48935337 46440849 1.05
tpcds_q03/datafusion:parquet 16274769 15832687 1.03
tpcds_q04/datafusion:parquet 354941654 324422149 1.09
tpcds_q05/datafusion:parquet 55938294 52295033 1.07
tpcds_q06/datafusion:parquet 68293307 65695296 1.04
tpcds_q07/datafusion:parquet 🚨 98610833 87556191 1.13
tpcds_q08/datafusion:parquet 36584037 34288214 1.07
tpcds_q09/datafusion:parquet 60702321 56567363 1.07
tpcds_q10/datafusion:parquet 86321063 81725942 1.06
tpcds_q11/datafusion:parquet 197731755 179770092 1.10
tpcds_q12/datafusion:parquet 25150694 23265647 1.08
tpcds_q13/datafusion:parquet 92163141 88399062 1.04
tpcds_q14/datafusion:parquet 207496918 199589751 1.04
tpcds_q15/datafusion:parquet 🚨 29758937 26645845 1.12
tpcds_q16/datafusion:parquet 30909507 29103254 1.06
tpcds_q17/datafusion:parquet 76554520 72086455 1.06
tpcds_q18/datafusion:parquet 🚨 144407435 130207602 1.11
tpcds_q19/datafusion:parquet 🚨 30850405 27982521 1.10
tpcds_q20/datafusion:parquet 🚨 23373307 20689328 1.13
tpcds_q21/datafusion:parquet 24831560 22625342 1.10
tpcds_q22/datafusion:parquet 150089222 147168999 1.02
tpcds_q23/datafusion:parquet 🚨 185385419 164863716 1.12
tpcds_q24/datafusion:parquet 115059148 106388231 1.08
tpcds_q25/datafusion:parquet 76855643 73403150 1.05
tpcds_q26/datafusion:parquet 82159251 75410302 1.09
tpcds_q27/datafusion:parquet 176564747 162185508 1.09
tpcds_q28/datafusion:parquet 52449139 48377230 1.08
tpcds_q29/datafusion:parquet 🚨 80588732 72421349 1.11
tpcds_q30/datafusion:parquet 48525614 46299280 1.05
tpcds_q31/datafusion:parquet 81570191 77452826 1.05
tpcds_q32/datafusion:parquet 🚨 24914952 22536880 1.11
tpcds_q33/datafusion:parquet 🚨 39476288 35867821 1.10
tpcds_q34/datafusion:parquet 28910500 27613320 1.05
tpcds_q35/datafusion:parquet 🚨 95536784 85770544 1.11
tpcds_q36/datafusion:parquet 🚨 71718395 65128730 1.10
tpcds_q37/datafusion:parquet 🚨 26082050 23482590 1.11
tpcds_q38/datafusion:parquet 55853296 52021203 1.07
tpcds_q39/datafusion:parquet 🚨 96322344 84489976 1.14
tpcds_q40/datafusion:parquet 30138667 27732923 1.09
tpcds_q41/datafusion:parquet 🚨 18561832 16443695 1.13
tpcds_q42/datafusion:parquet 🚨 15779475 14310611 1.10
tpcds_q43/datafusion:parquet 🚨 22156204 18437454 1.20
tpcds_q44/datafusion:parquet 🚨 47107243 42537569 1.11
tpcds_q45/datafusion:parquet 🚨 36049695 32770259 1.10
tpcds_q46/datafusion:parquet 43398566 39610765 1.10
tpcds_q47/datafusion:parquet 🚨 154537854 138291358 1.12
tpcds_q48/datafusion:parquet 87528952 81544395 1.07
tpcds_q49/datafusion:parquet 🚨 72923857 64402931 1.13
tpcds_q50/datafusion:parquet 🚨 53667614 48613544 1.10
tpcds_q51/datafusion:parquet 97985118 90605415 1.08
tpcds_q52/datafusion:parquet 15804546 14639104 1.08
tpcds_q53/datafusion:parquet 🚨 24985150 22278947 1.12
tpcds_q54/datafusion:parquet 🚨 48334547 42479645 1.14
tpcds_q55/datafusion:parquet 15081964 13906932 1.08
tpcds_q56/datafusion:parquet 37616025 36377268 1.03
tpcds_q57/datafusion:parquet 113672199 111991609 1.02
tpcds_q58/datafusion:parquet 62406941 58956482 1.06
tpcds_q59/datafusion:parquet 63087521 62999510 1.00
tpcds_q60/datafusion:parquet 38937435 36442208 1.07
tpcds_q61/datafusion:parquet 55577972 51058662 1.09
tpcds_q62/datafusion:parquet 26571558 29044220 0.91
tpcds_q63/datafusion:parquet 23762587 22652587 1.05
tpcds_q64/datafusion:parquet 606039319 557613576 1.09
tpcds_q65/datafusion:parquet 48427318 45243751 1.07
tpcds_q66/datafusion:parquet 🚨 87033760 76990681 1.13
tpcds_q67/datafusion:parquet 🚨 167867378 151547642 1.11
tpcds_q68/datafusion:parquet 🚨 42899104 38991284 1.10
tpcds_q69/datafusion:parquet 86616084 79866868 1.08
tpcds_q70/datafusion:parquet 102162041 99888503 1.02
tpcds_q71/datafusion:parquet 28120846 27353792 1.03
tpcds_q72/datafusion:parquet 🚨 705930117 634250505 1.11
tpcds_q73/datafusion:parquet 28976937 27422166 1.06
tpcds_q74/datafusion:parquet 🚨 115004946 103896277 1.11
tpcds_q75/datafusion:parquet 126929314 119550756 1.06
tpcds_q76/datafusion:parquet 🚨 38651809 35000908 1.10
tpcds_q77/datafusion:parquet 53354866 49840291 1.07
tpcds_q78/datafusion:parquet 🚨 137307030 123840078 1.11
tpcds_q79/datafusion:parquet 34132613 31716401 1.08
tpcds_q80/datafusion:parquet 🚨 105673722 93267308 1.13
tpcds_q81/datafusion:parquet 44622588 41899744 1.06
tpcds_q82/datafusion:parquet 25397812 23485900 1.08
tpcds_q83/datafusion:parquet 54316394 49437875 1.10
tpcds_q84/datafusion:parquet 51903965 49057706 1.06
tpcds_q85/datafusion:parquet 187331816 171231589 1.09
tpcds_q86/datafusion:parquet 18380775 17183408 1.07
tpcds_q87/datafusion:parquet 🚨 57974925 50283179 1.15
tpcds_q88/datafusion:parquet 🚨 77770163 70569385 1.10
tpcds_q89/datafusion:parquet 27101210 24861189 1.09
tpcds_q90/datafusion:parquet 🚨 20822171 18766694 1.11
tpcds_q91/datafusion:parquet 74863356 72875967 1.03
tpcds_q92/datafusion:parquet 23988581 22471768 1.07
tpcds_q93/datafusion:parquet 🚨 41310504 36637239 1.13
tpcds_q94/datafusion:parquet 27047485 25479081 1.06
tpcds_q95/datafusion:parquet 73143041 68544529 1.07
tpcds_q96/datafusion:parquet 🚨 16914418 14840581 1.14
tpcds_q97/datafusion:parquet 🚨 39308356 32148275 1.22
tpcds_q98/datafusion:parquet 28823369 26447527 1.09
tpcds_q99/datafusion:parquet 🚨 32217482 29024513 1.11
duckdb / vortex-file-compressed (1.010x ➖, 1↑ 4↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 🚨 28400255 25797346 1.10
tpcds_q02/duckdb:vortex-file-compressed 85728094 85358519 1.00
tpcds_q03/duckdb:vortex-file-compressed 24288193 24210081 1.00
tpcds_q04/duckdb:vortex-file-compressed 112904651 109295549 1.03
tpcds_q05/duckdb:vortex-file-compressed 104369857 97992603 1.07
tpcds_q06/duckdb:vortex-file-compressed 37752597 37043992 1.02
tpcds_q07/duckdb:vortex-file-compressed 25071075 25732971 0.97
tpcds_q08/duckdb:vortex-file-compressed 24102277 24806634 0.97
tpcds_q09/duckdb:vortex-file-compressed 40892674 40416111 1.01
tpcds_q10/duckdb:vortex-file-compressed 37982867 37088748 1.02
tpcds_q11/duckdb:vortex-file-compressed 64207257 65338788 0.98
tpcds_q12/duckdb:vortex-file-compressed 15503931 15280685 1.01
tpcds_q13/duckdb:vortex-file-compressed 34045323 33630927 1.01
tpcds_q14/duckdb:vortex-file-compressed 201124040 190493219 1.06
tpcds_q15/duckdb:vortex-file-compressed 41376919 42763293 0.97
tpcds_q16/duckdb:vortex-file-compressed 31701600 31881105 0.99
tpcds_q17/duckdb:vortex-file-compressed 40714389 39968327 1.02
tpcds_q18/duckdb:vortex-file-compressed 47131922 48266938 0.98
tpcds_q19/duckdb:vortex-file-compressed 34229514 33391355 1.03
tpcds_q20/duckdb:vortex-file-compressed 16576747 17047435 0.97
tpcds_q21/duckdb:vortex-file-compressed 20889356 19162085 1.09
tpcds_q22/duckdb:vortex-file-compressed 111743744 111197924 1.00
tpcds_q23/duckdb:vortex-file-compressed 130059916 127704887 1.02
tpcds_q24/duckdb:vortex-file-compressed 58561838 57189512 1.02
tpcds_q25/duckdb:vortex-file-compressed 39169968 38697165 1.01
tpcds_q26/duckdb:vortex-file-compressed 42370965 41197710 1.03
tpcds_q27/duckdb:vortex-file-compressed 92318836 90018141 1.03
tpcds_q28/duckdb:vortex-file-compressed 36822128 38867589 0.95
tpcds_q29/duckdb:vortex-file-compressed 39277473 39843399 0.99
tpcds_q30/duckdb:vortex-file-compressed 29610371 29896827 0.99
tpcds_q31/duckdb:vortex-file-compressed 28113774 26858663 1.05
tpcds_q32/duckdb:vortex-file-compressed 16834197 17385266 0.97
tpcds_q33/duckdb:vortex-file-compressed 🚨 74837112 66033044 1.13
tpcds_q34/duckdb:vortex-file-compressed 20382911 20455446 1.00
tpcds_q35/duckdb:vortex-file-compressed 66691606 62057946 1.07
tpcds_q36/duckdb:vortex-file-compressed 27330496 28071588 0.97
tpcds_q37/duckdb:vortex-file-compressed 23545981 22420206 1.05
tpcds_q38/duckdb:vortex-file-compressed 38851009 37262399 1.04
tpcds_q39/duckdb:vortex-file-compressed 47033371 48895853 0.96
tpcds_q40/duckdb:vortex-file-compressed 24308140 25078088 0.97
tpcds_q41/duckdb:vortex-file-compressed 13905527 14397055 0.97
tpcds_q42/duckdb:vortex-file-compressed 12323411 11995043 1.03
tpcds_q43/duckdb:vortex-file-compressed 21202498 20558077 1.03
tpcds_q44/duckdb:vortex-file-compressed 23525768 23607344 1.00
tpcds_q45/duckdb:vortex-file-compressed 27242848 28486095 0.96
tpcds_q46/duckdb:vortex-file-compressed 50840544 49038107 1.04
tpcds_q47/duckdb:vortex-file-compressed 50889295 49628751 1.03
tpcds_q48/duckdb:vortex-file-compressed 32137794 30904966 1.04
tpcds_q49/duckdb:vortex-file-compressed 31309450 31947283 0.98
tpcds_q50/duckdb:vortex-file-compressed 37482034 37774804 0.99
tpcds_q51/duckdb:vortex-file-compressed 103752388 99399337 1.04
tpcds_q52/duckdb:vortex-file-compressed 13263509 12806602 1.04
tpcds_q53/duckdb:vortex-file-compressed 17995091 17182873 1.05
tpcds_q54/duckdb:vortex-file-compressed 49595704 48517487 1.02
tpcds_q55/duckdb:vortex-file-compressed 12220538 12720039 0.96
tpcds_q56/duckdb:vortex-file-compressed 70241735 68787248 1.02
tpcds_q57/duckdb:vortex-file-compressed 45264087 45668149 0.99
tpcds_q58/duckdb:vortex-file-compressed 34146097 34458965 0.99
tpcds_q59/duckdb:vortex-file-compressed 57337571 58206570 0.99
tpcds_q60/duckdb:vortex-file-compressed 🚨 77936428 70567607 1.10
tpcds_q61/duckdb:vortex-file-compressed 39130167 40090588 0.98
tpcds_q62/duckdb:vortex-file-compressed 18870062 20567536 0.92
tpcds_q63/duckdb:vortex-file-compressed 18211830 17938647 1.02
tpcds_q64/duckdb:vortex-file-compressed 83475385 81478265 1.02
tpcds_q65/duckdb:vortex-file-compressed 24382755 24377346 1.00
tpcds_q66/duckdb:vortex-file-compressed 🚨 60037795 54523414 1.10
tpcds_q67/duckdb:vortex-file-compressed 149601682 145424587 1.03
tpcds_q68/duckdb:vortex-file-compressed 42911648 41857149 1.03
tpcds_q69/duckdb:vortex-file-compressed 39595750 39120309 1.01
tpcds_q70/duckdb:vortex-file-compressed 24507751 25312173 0.97
tpcds_q71/duckdb:vortex-file-compressed 22083941 22000826 1.00
tpcds_q72/duckdb:vortex-file-compressed 178920459 179683597 1.00
tpcds_q73/duckdb:vortex-file-compressed 20940185 20187574 1.04
tpcds_q74/duckdb:vortex-file-compressed 54167203 50428855 1.07
tpcds_q75/duckdb:vortex-file-compressed 62683536 62449008 1.00
tpcds_q76/duckdb:vortex-file-compressed 🚀 60844636 68737374 0.89
tpcds_q77/duckdb:vortex-file-compressed 68395584 64679354 1.06
tpcds_q78/duckdb:vortex-file-compressed 78710314 80770362 0.97
tpcds_q79/duckdb:vortex-file-compressed 37345266 37986656 0.98
tpcds_q80/duckdb:vortex-file-compressed 95071161 89630117 1.06
tpcds_q81/duckdb:vortex-file-compressed 34456232 34985049 0.98
tpcds_q82/duckdb:vortex-file-compressed 22902634 23056340 0.99
tpcds_q83/duckdb:vortex-file-compressed 28621949 27753769 1.03
tpcds_q84/duckdb:vortex-file-compressed 18018589 18167108 0.99
tpcds_q85/duckdb:vortex-file-compressed 47645314 46228074 1.03
tpcds_q86/duckdb:vortex-file-compressed 17144306 17773875 0.96
tpcds_q87/duckdb:vortex-file-compressed 41791266 44698184 0.93
tpcds_q88/duckdb:vortex-file-compressed 36575777 36331355 1.01
tpcds_q89/duckdb:vortex-file-compressed 18354149 18676999 0.98
tpcds_q90/duckdb:vortex-file-compressed 16128919 15733257 1.03
tpcds_q91/duckdb:vortex-file-compressed 27366807 27492304 1.00
tpcds_q92/duckdb:vortex-file-compressed 14834046 14213193 1.04
tpcds_q93/duckdb:vortex-file-compressed 30802100 30036090 1.03
tpcds_q94/duckdb:vortex-file-compressed 24500885 22858367 1.07
tpcds_q95/duckdb:vortex-file-compressed 156877679 159417398 0.98
tpcds_q96/duckdb:vortex-file-compressed 12877588 13077464 0.98
tpcds_q97/duckdb:vortex-file-compressed 40771592 39971530 1.02
tpcds_q98/duckdb:vortex-file-compressed 18541533 18608984 1.00
tpcds_q99/duckdb:vortex-file-compressed 32783849 32569735 1.01
duckdb / vortex-compact (1.003x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 34731785 34415932 1.01
tpcds_q02/duckdb:vortex-compact 129656789 125114210 1.04
tpcds_q03/duckdb:vortex-compact 50689394 52013218 0.97
tpcds_q04/duckdb:vortex-compact 122889182 123477885 1.00
tpcds_q05/duckdb:vortex-compact 169787924 164431694 1.03
tpcds_q06/duckdb:vortex-compact 39400981 37482721 1.05
tpcds_q07/duckdb:vortex-compact 37778870 36970584 1.02
tpcds_q08/duckdb:vortex-compact 30711169 29279003 1.05
tpcds_q09/duckdb:vortex-compact 111762899 110967874 1.01
tpcds_q10/duckdb:vortex-compact 46780451 47014615 1.00
tpcds_q11/duckdb:vortex-compact 75398656 75206653 1.00
tpcds_q12/duckdb:vortex-compact 20509039 20382189 1.01
tpcds_q13/duckdb:vortex-compact 49288212 48567553 1.01
tpcds_q14/duckdb:vortex-compact 269804348 270648570 1.00
tpcds_q15/duckdb:vortex-compact 46034257 45489860 1.01
tpcds_q16/duckdb:vortex-compact 37315208 37462592 1.00
tpcds_q17/duckdb:vortex-compact 50896286 50122717 1.02
tpcds_q18/duckdb:vortex-compact 66889167 67658400 0.99
tpcds_q19/duckdb:vortex-compact 39134710 38485442 1.02
tpcds_q20/duckdb:vortex-compact 20574569 21446625 0.96
tpcds_q21/duckdb:vortex-compact 28892807 30089689 0.96
tpcds_q22/duckdb:vortex-compact 118011611 117100072 1.01
tpcds_q23/duckdb:vortex-compact 163901704 171773224 0.95
tpcds_q24/duckdb:vortex-compact 71356638 69539938 1.03
tpcds_q25/duckdb:vortex-compact 48833737 49206513 0.99
tpcds_q26/duckdb:vortex-compact 53560303 52564134 1.02
tpcds_q27/duckdb:vortex-compact 133868405 132140678 1.01
tpcds_q28/duckdb:vortex-compact 106787545 106806488 1.00
tpcds_q29/duckdb:vortex-compact 49026279 51768119 0.95
tpcds_q30/duckdb:vortex-compact 34935251 35191742 0.99
tpcds_q31/duckdb:vortex-compact 31051312 30237510 1.03
tpcds_q32/duckdb:vortex-compact 23450617 23605313 0.99
tpcds_q33/duckdb:vortex-compact 142250830 136767997 1.04
tpcds_q34/duckdb:vortex-compact 25285028 24526821 1.03
tpcds_q35/duckdb:vortex-compact 69023343 67401469 1.02
tpcds_q36/duckdb:vortex-compact 34645592 35509659 0.98
tpcds_q37/duckdb:vortex-compact 32140241 32014516 1.00
tpcds_q38/duckdb:vortex-compact 40554041 40104591 1.01
tpcds_q39/duckdb:vortex-compact 54991846 53757328 1.02
tpcds_q40/duckdb:vortex-compact 32045407 30846280 1.04
tpcds_q41/duckdb:vortex-compact 17477879 17681682 0.99
tpcds_q42/duckdb:vortex-compact 15174759 15574120 0.97
tpcds_q43/duckdb:vortex-compact 24927758 25221339 0.99
tpcds_q44/duckdb:vortex-compact 31170011 30963641 1.01
tpcds_q45/duckdb:vortex-compact 32368132 31220217 1.04
tpcds_q46/duckdb:vortex-compact 58689834 56368647 1.04
tpcds_q47/duckdb:vortex-compact 54733816 55921982 0.98
tpcds_q48/duckdb:vortex-compact 42930445 42444916 1.01
tpcds_q49/duckdb:vortex-compact 46471504 47086397 0.99
tpcds_q50/duckdb:vortex-compact 42719998 43652114 0.98
tpcds_q51/duckdb:vortex-compact 105572305 103782494 1.02
tpcds_q52/duckdb:vortex-compact 15556569 16400298 0.95
tpcds_q53/duckdb:vortex-compact 22405849 23073361 0.97
tpcds_q54/duckdb:vortex-compact 86967732 85269772 1.02
tpcds_q55/duckdb:vortex-compact 15264882 15424080 0.99
tpcds_q56/duckdb:vortex-compact 129375140 128562692 1.01
tpcds_q57/duckdb:vortex-compact 48234339 50409863 0.96
tpcds_q58/duckdb:vortex-compact 41298284 41776585 0.99
tpcds_q59/duckdb:vortex-compact 65563036 68683831 0.95
tpcds_q60/duckdb:vortex-compact 135801700 134369552 1.01
tpcds_q61/duckdb:vortex-compact 49635772 51505364 0.96
tpcds_q62/duckdb:vortex-compact 22698733 22306901 1.02
tpcds_q63/duckdb:vortex-compact 23323633 23205518 1.01
tpcds_q64/duckdb:vortex-compact 100973914 99256503 1.02
tpcds_q65/duckdb:vortex-compact 28639589 28433579 1.01
tpcds_q66/duckdb:vortex-compact 100328631 94978229 1.06
tpcds_q67/duckdb:vortex-compact 150364456 155737136 0.97
tpcds_q68/duckdb:vortex-compact 50950121 51731652 0.98
tpcds_q69/duckdb:vortex-compact 46121758 47233912 0.98
tpcds_q70/duckdb:vortex-compact 29765976 30086909 0.99
tpcds_q71/duckdb:vortex-compact 26050696 25734581 1.01
tpcds_q72/duckdb:vortex-compact 200960884 197847998 1.02
tpcds_q73/duckdb:vortex-compact 23669952 23859858 0.99
tpcds_q74/duckdb:vortex-compact 56387342 56294536 1.00
tpcds_q75/duckdb:vortex-compact 71396857 72984798 0.98
tpcds_q76/duckdb:vortex-compact 125279384 119965769 1.04
tpcds_q77/duckdb:vortex-compact 128688476 120925326 1.06
tpcds_q78/duckdb:vortex-compact 84916535 84535764 1.00
tpcds_q79/duckdb:vortex-compact 55044919 51377586 1.07
tpcds_q80/duckdb:vortex-compact 152379757 154881368 0.98
tpcds_q81/duckdb:vortex-compact 38855533 41475889 0.94
tpcds_q82/duckdb:vortex-compact 31353943 32402731 0.97
tpcds_q83/duckdb:vortex-compact 44367368 45467594 0.98
tpcds_q84/duckdb:vortex-compact 21017578 21607188 0.97
tpcds_q85/duckdb:vortex-compact 60293118 60353120 1.00
tpcds_q86/duckdb:vortex-compact 18888240 20111934 0.94
tpcds_q87/duckdb:vortex-compact 42301815 40625846 1.04
tpcds_q88/duckdb:vortex-compact 38089988 38532300 0.99
tpcds_q89/duckdb:vortex-compact 23546541 23351450 1.01
tpcds_q90/duckdb:vortex-compact 16369207 16447791 1.00
tpcds_q91/duckdb:vortex-compact 44335470 43663840 1.02
tpcds_q92/duckdb:vortex-compact 20148284 20379675 0.99
tpcds_q93/duckdb:vortex-compact 36873055 35498864 1.04
tpcds_q94/duckdb:vortex-compact 28664642 28755668 1.00
tpcds_q95/duckdb:vortex-compact 165636978 160147098 1.03
tpcds_q96/duckdb:vortex-compact 14121239 13654384 1.03
tpcds_q97/duckdb:vortex-compact 42852750 41243836 1.04
tpcds_q98/duckdb:vortex-compact 23763970 23499777 1.01
tpcds_q99/duckdb:vortex-compact 🚨 38900195 34953090 1.11
duckdb / parquet (1.016x ➖, 0↑ 2↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 46325511 44748803 1.04
tpcds_q02/duckdb:parquet 62119026 60574274 1.03
tpcds_q03/duckdb:parquet 12267270 11936075 1.03
tpcds_q04/duckdb:parquet 127161911 127979281 0.99
tpcds_q05/duckdb:parquet 70795764 66813429 1.06
tpcds_q06/duckdb:parquet 29775830 28530066 1.04
tpcds_q07/duckdb:parquet 23359993 23746587 0.98
tpcds_q08/duckdb:parquet 28098736 28108294 1.00
tpcds_q09/duckdb:parquet 40203747 39512161 1.02
tpcds_q10/duckdb:parquet 37421327 34623686 1.08
tpcds_q11/duckdb:parquet 89635411 87516524 1.02
tpcds_q12/duckdb:parquet 15143681 14689234 1.03
tpcds_q13/duckdb:parquet 35418718 34271364 1.03
tpcds_q14/duckdb:parquet 167424039 170561039 0.98
tpcds_q15/duckdb:parquet 30363767 29977643 1.01
tpcds_q16/duckdb:parquet 21588690 22191850 0.97
tpcds_q17/duckdb:parquet 38853547 39284998 0.99
tpcds_q18/duckdb:parquet 44888372 46550960 0.96
tpcds_q19/duckdb:parquet 30214242 29053617 1.04
tpcds_q20/duckdb:parquet 15598765 15668576 1.00
tpcds_q21/duckdb:parquet 12408056 12616007 0.98
tpcds_q22/duckdb:parquet 72833306 69979847 1.04
tpcds_q23/duckdb:parquet 116650281 110363434 1.06
tpcds_q24/duckdb:parquet 47278472 46392317 1.02
tpcds_q25/duckdb:parquet 34509782 32900358 1.05
tpcds_q26/duckdb:parquet 36583973 37277267 0.98
tpcds_q27/duckdb:parquet 90820097 90436565 1.00
tpcds_q28/duckdb:parquet 37640473 37293021 1.01
tpcds_q29/duckdb:parquet 37557124 35714599 1.05
tpcds_q30/duckdb:parquet 41302792 39180155 1.05
tpcds_q31/duckdb:parquet 23185262 23281881 1.00
tpcds_q32/duckdb:parquet 11622431 11419495 1.02
tpcds_q33/duckdb:parquet 70925356 71774995 0.99
tpcds_q34/duckdb:parquet 21460943 20987544 1.02
tpcds_q35/duckdb:parquet 59624910 59571875 1.00
tpcds_q36/duckdb:parquet 20544719 20360926 1.01
tpcds_q37/duckdb:parquet 13680430 13511545 1.01
tpcds_q38/duckdb:parquet 33153713 32273583 1.03
tpcds_q39/duckdb:parquet 32715412 33230183 0.98
tpcds_q40/duckdb:parquet 18072708 17982246 1.01
tpcds_q41/duckdb:parquet 7805426 7565263 1.03
tpcds_q42/duckdb:parquet 🚨 11338949 10016457 1.13
tpcds_q43/duckdb:parquet 16088586 15581871 1.03
tpcds_q44/duckdb:parquet 22572779 20630965 1.09
tpcds_q45/duckdb:parquet 26744249 27267998 0.98
tpcds_q46/duckdb:parquet 48323792 47065420 1.03
tpcds_q47/duckdb:parquet 46314608 45853005 1.01
tpcds_q48/duckdb:parquet 32675300 30614829 1.07
tpcds_q49/duckdb:parquet 24259728 24525255 0.99
tpcds_q50/duckdb:parquet 25264518 24720293 1.02
tpcds_q51/duckdb:parquet 96089549 97444897 0.99
tpcds_q52/duckdb:parquet 11197081 11166427 1.00
tpcds_q53/duckdb:parquet 16276195 16113710 1.01
tpcds_q54/duckdb:parquet 39298772 40780264 0.96
tpcds_q55/duckdb:parquet 10888658 10501059 1.04
tpcds_q56/duckdb:parquet 69366032 67983708 1.02
tpcds_q57/duckdb:parquet 36287102 35371883 1.03
tpcds_q58/duckdb:parquet 21727313 21521724 1.01
tpcds_q59/duckdb:parquet 36932282 36267779 1.02
tpcds_q60/duckdb:parquet 74395152 72827570 1.02
tpcds_q61/duckdb:parquet 29652096 31116562 0.95
tpcds_q62/duckdb:parquet 12282256 11424040 1.08
tpcds_q63/duckdb:parquet 15434620 15108687 1.02
tpcds_q64/duckdb:parquet 73856989 74832221 0.99
tpcds_q65/duckdb:parquet 20376521 20278113 1.00
tpcds_q66/duckdb:parquet 54364769 56847500 0.96
tpcds_q67/duckdb:parquet 137308388 138203917 0.99
tpcds_q68/duckdb:parquet 37557197 38396794 0.98
tpcds_q69/duckdb:parquet 38131039 38217010 1.00
tpcds_q70/duckdb:parquet 19936187 19441584 1.03
tpcds_q71/duckdb:parquet 19762760 19546189 1.01
tpcds_q72/duckdb:parquet 165732915 166377608 1.00
tpcds_q73/duckdb:parquet 18588974 18731867 0.99
tpcds_q74/duckdb:parquet 50781286 50671078 1.00
tpcds_q75/duckdb:parquet 52600732 53156952 0.99
tpcds_q76/duckdb:parquet 🚨 73618934 66511303 1.11
tpcds_q77/duckdb:parquet 60725988 62572216 0.97
tpcds_q78/duckdb:parquet 75328759 72220055 1.04
tpcds_q79/duckdb:parquet 28203350 28555730 0.99
tpcds_q80/duckdb:parquet 83316492 82944727 1.00
tpcds_q81/duckdb:parquet 48336353 47818951 1.01
tpcds_q82/duckdb:parquet 16119385 15799600 1.02
tpcds_q83/duckdb:parquet 16056538 16102588 1.00
tpcds_q84/duckdb:parquet 19870081 19798951 1.00
tpcds_q85/duckdb:parquet 41079122 38912122 1.06
tpcds_q86/duckdb:parquet 12438087 12386259 1.00
tpcds_q87/duckdb:parquet 40349849 37914112 1.06
tpcds_q88/duckdb:parquet 29384334 29136940 1.01
tpcds_q89/duckdb:parquet 18111643 17347515 1.04
tpcds_q90/duckdb:parquet 7926880 7482131 1.06
tpcds_q91/duckdb:parquet 23837783 23697001 1.01
tpcds_q92/duckdb:parquet 12251568 11510701 1.06
tpcds_q93/duckdb:parquet 30412030 30588204 0.99
tpcds_q94/duckdb:parquet 15765079 16079302 0.98
tpcds_q95/duckdb:parquet 143614431 131557583 1.09
tpcds_q96/duckdb:parquet 9596385 9308474 1.03
tpcds_q97/duckdb:parquet 34922373 36201008 0.96
tpcds_q98/duckdb:parquet 19123509 18190018 1.05
tpcds_q99/duckdb:parquet 20122664 20299605 0.99
duckdb / duckdb (0.988x ➖, 2↑ 4↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 20105369 20902796 0.96
tpcds_q02/duckdb:duckdb 18425086 18594710 0.99
tpcds_q03/duckdb:duckdb 8120941 8592120 0.95
tpcds_q04/duckdb:duckdb 161889669 164536249 0.98
tpcds_q05/duckdb:duckdb 17687535 18275492 0.97
tpcds_q06/duckdb:duckdb 24115151 22493513 1.07
tpcds_q07/duckdb:duckdb 37510877 38850621 0.97
tpcds_q08/duckdb:duckdb 119047286 119110205 1.00
tpcds_q09/duckdb:duckdb 19791397 19555894 1.01
tpcds_q10/duckdb:duckdb 23154061 23244802 1.00
tpcds_q11/duckdb:duckdb 142325371 139936731 1.02
tpcds_q12/duckdb:duckdb 11350359 10755652 1.06
tpcds_q13/duckdb:duckdb 23059311 23928361 0.96
tpcds_q14/duckdb:duckdb 93383736 94103566 0.99
tpcds_q15/duckdb:duckdb 23961165 23972450 1.00
tpcds_q16/duckdb:duckdb 🚨 18305871 16452786 1.11
tpcds_q17/duckdb:duckdb 20821577 21143919 0.98
tpcds_q18/duckdb:duckdb 43003121 44565574 0.96
tpcds_q19/duckdb:duckdb 16093856 16536782 0.97
tpcds_q20/duckdb:duckdb 11764945 11513913 1.02
tpcds_q21/duckdb:duckdb 6308492 6926720 0.91
tpcds_q22/duckdb:duckdb 59391307 61191524 0.97
tpcds_q23/duckdb:duckdb 78975845 76381706 1.03
tpcds_q24/duckdb:duckdb 24031188 23914689 1.00
tpcds_q25/duckdb:duckdb 16287525 16691543 0.98
tpcds_q26/duckdb:duckdb 🚨 26893732 24263759 1.11
tpcds_q27/duckdb:duckdb 39614269 40837149 0.97
tpcds_q28/duckdb:duckdb 21108735 21369318 0.99
tpcds_q29/duckdb:duckdb 19762156 20007600 0.99
tpcds_q30/duckdb:duckdb 28198934 28885824 0.98
tpcds_q31/duckdb:duckdb 19574335 20054030 0.98
tpcds_q32/duckdb:duckdb 6527424 7055416 0.93
tpcds_q33/duckdb:duckdb 12236755 12766165 0.96
tpcds_q34/duckdb:duckdb 14313211 14487014 0.99
tpcds_q35/duckdb:duckdb 31237641 33284058 0.94
tpcds_q36/duckdb:duckdb 69031078 69616285 0.99
tpcds_q37/duckdb:duckdb 7495792 7502166 1.00
tpcds_q38/duckdb:duckdb 29705642 30366628 0.98
tpcds_q39/duckdb:duckdb 🚀 25666481 30468744 0.84
tpcds_q40/duckdb:duckdb 12858775 13072133 0.98
tpcds_q41/duckdb:duckdb 8008387 7999768 1.00
tpcds_q42/duckdb:duckdb 6464773 6084125 1.06
tpcds_q43/duckdb:duckdb 10985018 11132958 0.99
tpcds_q44/duckdb:duckdb 13557003 13930070 0.97
tpcds_q45/duckdb:duckdb 16455574 16844325 0.98
tpcds_q46/duckdb:duckdb 35213290 35603181 0.99
tpcds_q47/duckdb:duckdb 40664346 40614206 1.00
tpcds_q48/duckdb:duckdb 21469680 21251730 1.01
tpcds_q49/duckdb:duckdb 🚨 17442861 15216308 1.15
tpcds_q50/duckdb:duckdb 13663239 13839653 0.99
tpcds_q51/duckdb:duckdb 90508480 92716369 0.98
tpcds_q52/duckdb:duckdb 7133727 7453659 0.96
tpcds_q53/duckdb:duckdb 11311915 11851725 0.95
tpcds_q54/duckdb:duckdb 16638408 17391802 0.96
tpcds_q55/duckdb:duckdb 6693097 7001915 0.96
tpcds_q56/duckdb:duckdb 12992582 13408625 0.97
tpcds_q57/duckdb:duckdb 30858096 30952960 1.00
tpcds_q58/duckdb:duckdb 12535381 11766876 1.07
tpcds_q59/duckdb:duckdb 34529811 34723433 0.99
tpcds_q60/duckdb:duckdb 14600538 15075243 0.97
tpcds_q61/duckdb:duckdb 13898749 14364427 0.97
tpcds_q62/duckdb:duckdb 8944672 9266949 0.97
tpcds_q63/duckdb:duckdb 11069059 11440823 0.97
tpcds_q64/duckdb:duckdb 50197945 52194848 0.96
tpcds_q65/duckdb:duckdb 31502894 33292546 0.95
tpcds_q66/duckdb:duckdb 23507829 25088674 0.94
tpcds_q67/duckdb:duckdb 124439723 127636456 0.97
tpcds_q68/duckdb:duckdb 24564082 24704381 0.99
tpcds_q69/duckdb:duckdb 22912175 24000564 0.95
tpcds_q70/duckdb:duckdb 15331757 15378050 1.00
tpcds_q71/duckdb:duckdb 12116833 12707962 0.95
tpcds_q72/duckdb:duckdb 42259426 42488777 0.99
tpcds_q73/duckdb:duckdb 10259880 10482786 0.98
tpcds_q74/duckdb:duckdb 95974701 98327997 0.98
tpcds_q75/duckdb:duckdb 42578771 43170881 0.99
tpcds_q76/duckdb:duckdb 11504923 12045317 0.96
tpcds_q77/duckdb:duckdb 11820504 11513444 1.03
tpcds_q78/duckdb:duckdb 63434152 61353890 1.03
tpcds_q79/duckdb:duckdb 17580379 17675633 0.99
tpcds_q80/duckdb:duckdb 25798662 27118227 0.95
tpcds_q81/duckdb:duckdb 35739282 38039193 0.94
tpcds_q82/duckdb:duckdb 8106038 8305613 0.98
tpcds_q83/duckdb:duckdb 8951776 9270516 0.97
tpcds_q84/duckdb:duckdb 13944048 13619196 1.02
tpcds_q85/duckdb:duckdb 🚀 21834725 24319320 0.90
tpcds_q86/duckdb:duckdb 10750835 10781360 1.00
tpcds_q87/duckdb:duckdb 33408590 34035518 0.98
tpcds_q88/duckdb:duckdb 24134130 24174865 1.00
tpcds_q89/duckdb:duckdb 12939377 13148862 0.98
tpcds_q90/duckdb:duckdb 5383656 5641256 0.95
tpcds_q91/duckdb:duckdb 11547579 12538949 0.92
tpcds_q92/duckdb:duckdb 9237331 8551983 1.08
tpcds_q93/duckdb:duckdb 22382703 21361268 1.05
tpcds_q94/duckdb:duckdb 12481894 12656790 0.99
tpcds_q95/duckdb:duckdb 🚨 131934938 109861575 1.20
tpcds_q96/duckdb:duckdb 4485717 4416662 1.02
tpcds_q97/duckdb:duckdb 30066936 30326094 0.99
tpcds_q98/duckdb:duckdb 13422304 13340999 1.01
tpcds_q99/duckdb:duckdb 16465866 16898605 0.97
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +6.7% +4.1% +2.5% +11.2% ➖ noise
1 datafusion:vortex-file-compressed +10.1% +4.1% +5.7% +12.7% ➖ noise
1 duckdb:duckdb -3.8% +4.1% -7.6% +10.0% ➖ noise
1 duckdb:vortex-compact +0.9% +4.1% -3.1% +13.7% ➖ noise
1 duckdb:vortex-file-compressed +10.1% +4.1% +5.7% +14.3% ➖ noise
2 datafusion:vortex-compact +5.7% +4.0% +1.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +8.0% +4.0% +3.9% +10.0% ➖ noise
2 duckdb:duckdb -0.9% +4.0% -4.7% +10.0% ➖ noise
2 duckdb:vortex-compact +3.6% +4.0% -0.3% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.4% +4.0% -3.4% +12.2% ➖ noise
3 datafusion:vortex-compact +8.4% +2.8% +5.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +9.7% +2.8% +6.7% +10.0% ➖ noise
3 duckdb:duckdb -5.5% +2.8% -8.0% +16.8% ➖ noise
3 duckdb:vortex-compact -2.5% +2.8% -5.2% +11.3% ➖ noise
3 duckdb:vortex-file-compressed +0.3% +2.8% -2.4% +10.1% ➖ noise
4 datafusion:vortex-compact +6.4% +4.3% +2.0% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +9.4% +4.3% +5.0% +10.0% ➖ noise
4 duckdb:duckdb -1.6% +4.3% -5.6% +10.0% ➖ noise
4 duckdb:vortex-compact -0.5% +4.3% -4.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +3.3% +4.3% -0.9% +10.0% ➖ noise
5 datafusion:vortex-compact +7.3% +6.5% +0.8% +10.9% ➖ noise
5 datafusion:vortex-file-compressed +10.5% +6.5% +3.8% +10.2% ➖ noise
5 duckdb:duckdb -3.2% +6.5% -9.1% +12.3% ➖ noise
5 duckdb:vortex-compact +3.3% +6.5% -3.0% +13.7% ➖ noise
5 duckdb:vortex-file-compressed +6.5% +6.5% +0.0% +10.0% ➖ noise
6 datafusion:vortex-compact +7.3% +4.2% +3.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +7.8% +4.2% +3.5% +10.0% ➖ noise
6 duckdb:duckdb +7.2% +4.2% +2.9% +12.5% ➖ noise
6 duckdb:vortex-compact +5.1% +4.2% +0.9% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.9% +4.2% -2.2% +10.0% ➖ noise
7 datafusion:vortex-compact +7.0% +5.3% +1.7% +10.9% ➖ noise
7 datafusion:vortex-file-compressed +11.1% +5.3% +5.6% +10.0% ➖ noise
7 duckdb:duckdb -3.4% +5.3% -8.3% +20.7% ➖ noise
7 duckdb:vortex-compact +2.2% +5.3% -2.9% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.6% +5.3% -7.4% +10.0% ➖ noise
8 datafusion:vortex-compact +1.9% +3.3% -1.3% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +11.0% +3.3% +7.5% +10.0% ➖ noise
8 duckdb:duckdb -0.1% +3.3% -3.2% +10.0% ➖ noise
8 duckdb:vortex-compact +4.9% +3.3% +1.6% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -2.8% +3.3% -5.9% +11.0% ➖ noise
9 datafusion:vortex-compact +1.7% +4.5% -2.7% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +7.4% +4.5% +2.7% +10.0% ➖ noise
9 duckdb:duckdb +1.2% +4.5% -3.1% +10.0% ➖ noise
9 duckdb:vortex-compact +0.7% +4.5% -3.6% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.2% +4.5% -3.2% +10.0% ➖ noise
10 datafusion:vortex-compact +3.7% +6.8% -2.9% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +7.2% +6.8% +0.3% +10.0% ➖ noise
10 duckdb:duckdb -0.4% +6.8% -6.8% +11.8% ➖ noise
10 duckdb:vortex-compact -0.5% +6.8% -6.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.4% +6.8% -4.1% +10.0% ➖ noise
11 datafusion:vortex-compact +6.9% +6.1% +0.7% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +10.4% +6.1% +4.1% +10.0% ➖ noise
11 duckdb:duckdb +1.7% +6.1% -4.2% +10.0% ➖ noise
11 duckdb:vortex-compact +0.3% +6.1% -5.5% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -1.7% +6.1% -7.4% +10.0% ➖ noise
12 datafusion:vortex-compact +5.0% +5.6% -0.5% +12.6% ➖ noise
12 datafusion:vortex-file-compressed +5.1% +5.6% -0.4% +11.5% ➖ noise
12 duckdb:duckdb +5.5% +5.6% -0.0% +13.5% ➖ noise
12 duckdb:vortex-compact +0.6% +5.6% -4.7% +16.2% ➖ noise
12 duckdb:vortex-file-compressed +1.5% +5.6% -3.9% +11.9% ➖ noise
13 datafusion:vortex-compact +4.5% +3.8% +0.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +2.8% +3.8% -0.9% +10.0% ➖ noise
13 duckdb:duckdb -3.6% +3.8% -7.2% +10.0% ➖ noise
13 duckdb:vortex-compact +1.5% +3.8% -2.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.2% +3.8% -2.5% +11.3% ➖ noise
14 datafusion:vortex-compact +5.2% +1.0% +4.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +9.7% +1.0% +8.6% +10.0% ➖ noise
14 duckdb:duckdb -0.8% +1.0% -1.8% +10.0% ➖ noise
14 duckdb:vortex-compact -0.3% +1.0% -1.3% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +5.6% +1.0% +4.5% +11.3% ➖ noise
15 datafusion:vortex-compact +4.8% +6.4% -1.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +14.7% +6.4% +7.8% +11.4% ➖ noise
15 duckdb:duckdb -0.0% +6.4% -6.0% +11.9% ➖ noise
15 duckdb:vortex-compact +1.2% +6.4% -4.9% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -3.2% +6.4% -9.0% +14.7% ➖ noise
16 datafusion:vortex-compact -1.5% +1.6% -3.1% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +11.2% +1.6% +9.4% +10.0% ➖ noise
16 duckdb:duckdb +11.3% +1.6% +9.5% +16.9% ➖ noise
16 duckdb:vortex-compact -0.4% +1.6% -2.0% +10.7% ➖ noise
16 duckdb:vortex-file-compressed -0.6% +1.6% -2.2% +10.0% ➖ noise
17 datafusion:vortex-compact +5.6% +2.5% +3.0% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +8.7% +2.5% +6.1% +11.1% ➖ noise
17 duckdb:duckdb -1.5% +2.5% -3.9% +11.5% ➖ noise
17 duckdb:vortex-compact +1.5% +2.5% -0.9% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +1.9% +2.5% -0.6% +10.0% ➖ noise
18 datafusion:vortex-compact +2.9% +3.4% -0.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +8.5% +3.4% +4.9% +10.0% ➖ noise
18 duckdb:duckdb -3.5% +3.4% -6.7% +10.0% ➖ noise
18 duckdb:vortex-compact -1.1% +3.4% -4.4% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -2.4% +3.4% -5.6% +10.0% ➖ noise
19 datafusion:vortex-compact +5.1% +7.1% -1.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +4.3% +7.1% -2.6% +10.0% ➖ noise
19 duckdb:duckdb -2.7% +7.1% -9.1% +10.3% ➖ noise
19 duckdb:vortex-compact +1.7% +7.1% -5.0% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.5% +7.1% -4.3% +12.0% ➖ noise
20 datafusion:vortex-compact +5.0% +6.1% -1.0% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +9.4% +6.1% +3.2% +10.0% ➖ noise
20 duckdb:duckdb +2.2% +6.1% -3.7% +10.4% ➖ noise
20 duckdb:vortex-compact -4.1% +6.1% -9.5% +10.0% ✅ faster
20 duckdb:vortex-file-compressed -2.8% +6.1% -8.3% +10.0% ➖ noise
21 datafusion:vortex-compact +8.2% +3.9% +4.1% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +12.8% +3.9% +8.6% +10.0% ➖ noise
21 duckdb:duckdb -8.9% +3.9% -12.3% +13.5% ✅ faster
21 duckdb:vortex-compact -4.0% +3.9% -7.6% +14.8% ➖ noise
21 duckdb:vortex-file-compressed +9.0% +3.9% +4.9% +15.0% ➖ noise
22 datafusion:vortex-compact +0.4% +3.0% -2.5% +14.5% ➖ noise
22 datafusion:vortex-file-compressed +11.2% +3.0% +7.9% +16.0% ➖ noise
22 duckdb:duckdb -2.9% +3.0% -5.8% +17.3% ➖ noise
22 duckdb:vortex-compact +0.8% +3.0% -2.2% +12.1% ➖ noise
22 duckdb:vortex-file-compressed +0.5% +3.0% -2.5% +12.9% ➖ noise
23 datafusion:vortex-compact +6.1% +9.0% -2.6% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +9.8% +9.0% +0.7% +10.0% ➖ noise
23 duckdb:duckdb +3.4% +9.0% -5.2% +21.1% ➖ noise
23 duckdb:vortex-compact -4.6% +9.0% -12.5% +13.1% ✅ faster
23 duckdb:vortex-file-compressed +1.8% +9.0% -6.6% +10.0% ➖ noise
24 datafusion:vortex-compact +7.0% +5.0% +1.9% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +15.7% +5.0% +10.2% +10.0% 🚨 regression
24 duckdb:duckdb +0.5% +5.0% -4.3% +10.0% ➖ noise
24 duckdb:vortex-compact +2.6% +5.0% -2.3% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +2.4% +5.0% -2.5% +12.0% ➖ noise
25 datafusion:vortex-compact +3.0% +4.8% -1.7% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +15.7% +4.8% +10.4% +10.0% 🚨 regression
25 duckdb:duckdb -2.4% +4.8% -6.9% +10.5% ➖ noise
25 duckdb:vortex-compact -0.8% +4.8% -5.3% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +1.2% +4.8% -3.4% +10.0% ➖ noise
26 datafusion:vortex-compact +4.7% +3.4% +1.3% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +20.2% +3.4% +16.2% +10.0% 🚨 regression
26 duckdb:duckdb +10.8% +3.4% +7.2% +14.1% ➖ noise
26 duckdb:vortex-compact +1.9% +3.4% -1.5% +16.0% ➖ noise
26 duckdb:vortex-file-compressed +2.8% +3.4% -0.5% +10.0% ➖ noise
27 datafusion:vortex-compact +3.7% +4.6% -0.8% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +16.7% +4.6% +11.6% +10.0% 🚨 regression
27 duckdb:duckdb -3.0% +4.6% -7.2% +16.2% ➖ noise
27 duckdb:vortex-compact +1.3% +4.6% -3.1% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +2.6% +4.6% -1.9% +10.0% ➖ noise
28 datafusion:vortex-compact +6.5% +4.6% +1.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +9.4% +4.6% +4.6% +10.0% ➖ noise
28 duckdb:duckdb -1.2% +4.6% -5.6% +10.0% ➖ noise
28 duckdb:vortex-compact -0.0% +4.6% -4.4% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -5.3% +4.6% -9.4% +10.0% ✅ faster
29 datafusion:vortex-compact +6.1% +8.2% -1.9% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +9.2% +8.2% +1.0% +10.0% ➖ noise
29 duckdb:duckdb -1.2% +8.2% -8.7% +11.2% ➖ noise
29 duckdb:vortex-compact -5.3% +8.2% -12.5% +12.7% ✅ faster
29 duckdb:vortex-file-compressed -1.4% +8.2% -8.9% +10.6% ➖ noise
30 datafusion:vortex-compact +8.4% +5.1% +3.1% +13.6% ➖ noise
30 datafusion:vortex-file-compressed +12.0% +5.1% +6.6% +13.6% ➖ noise
30 duckdb:duckdb -2.4% +5.1% -7.1% +10.1% ➖ noise
30 duckdb:vortex-compact -0.7% +5.1% -5.6% +11.4% ➖ noise
30 duckdb:vortex-file-compressed -1.0% +5.1% -5.8% +12.0% ➖ noise
31 datafusion:vortex-compact +8.3% +2.4% +5.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +11.9% +2.4% +9.2% +10.0% ➖ noise
31 duckdb:duckdb -2.4% +2.4% -4.7% +12.1% ➖ noise
31 duckdb:vortex-compact +2.7% +2.4% +0.3% +14.6% ➖ noise
31 duckdb:vortex-file-compressed +4.7% +2.4% +2.2% +13.9% ➖ noise
32 datafusion:vortex-compact +10.2% +6.1% +3.9% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +15.5% +6.1% +8.9% +10.0% ➖ noise
32 duckdb:duckdb -7.5% +6.1% -12.8% +13.8% ✅ faster
32 duckdb:vortex-compact -0.7% +6.1% -6.3% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -3.2% +6.1% -8.7% +10.0% ➖ noise
33 datafusion:vortex-compact +3.9% +4.3% -0.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +8.1% +4.3% +3.7% +10.2% ➖ noise
33 duckdb:duckdb -4.1% +4.3% -8.1% +11.8% ➖ noise
33 duckdb:vortex-compact +4.0% +4.3% -0.3% +10.8% ➖ noise
33 duckdb:vortex-file-compressed +13.3% +4.3% +8.7% +16.1% ➖ noise
34 datafusion:vortex-compact +7.5% +3.5% +3.9% +10.0% ➖ noise
34 datafusion:vortex-file-compressed +10.9% +3.5% +7.2% +10.0% ➖ noise
34 duckdb:duckdb -1.2% +3.5% -4.5% +10.2% ➖ noise
34 duckdb:vortex-compact +3.1% +3.5% -0.4% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -0.4% +3.5% -3.7% +12.4% ➖ noise
35 datafusion:vortex-compact +3.6% +5.6% -1.8% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +8.0% +5.6% +2.3% +10.0% ➖ noise
35 duckdb:duckdb -6.1% +5.6% -11.1% +11.3% ✅ faster
35 duckdb:vortex-compact +2.4% +5.6% -3.0% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +7.5% +5.6% +1.8% +10.8% ➖ noise
36 datafusion:vortex-compact +4.4% +5.4% -1.0% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +7.4% +5.4% +1.9% +10.0% ➖ noise
36 duckdb:duckdb -0.8% +5.4% -5.9% +12.2% ➖ noise
36 duckdb:vortex-compact -2.4% +5.4% -7.4% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -2.6% +5.4% -7.6% +10.0% ➖ noise
37 datafusion:vortex-compact -3.6% +6.0% -9.1% +10.0% ✅ faster
37 datafusion:vortex-file-compressed +5.5% +6.0% -0.6% +10.0% ➖ noise
37 duckdb:duckdb -0.1% +6.0% -5.8% +17.2% ➖ noise
37 duckdb:vortex-compact +0.4% +6.0% -5.3% +11.3% ➖ noise
37 duckdb:vortex-file-compressed +5.0% +6.0% -1.0% +10.8% ➖ noise
38 datafusion:vortex-compact +2.8% +5.0% -2.2% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +8.9% +5.0% +3.7% +10.0% ➖ noise
38 duckdb:duckdb -2.2% +5.0% -6.9% +22.3% ➖ noise
38 duckdb:vortex-compact +1.1% +5.0% -3.7% +11.3% ➖ noise
38 duckdb:vortex-file-compressed +4.3% +5.0% -0.7% +11.6% ➖ noise
39 datafusion:vortex-compact +0.8% +5.9% -4.9% +12.1% ➖ noise
39 datafusion:vortex-file-compressed -4.1% +5.9% -9.5% +15.7% ➖ noise
39 duckdb:duckdb -15.8% +5.9% -20.5% +28.0% ➖ noise
39 duckdb:vortex-compact +2.3% +5.9% -3.4% +13.0% ➖ noise
39 duckdb:vortex-file-compressed -3.8% +5.9% -9.2% +16.5% ➖ noise
40 datafusion:vortex-compact +6.6% +4.5% +2.0% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +4.6% +4.5% +0.1% +10.0% ➖ noise
40 duckdb:duckdb -1.6% +4.5% -5.9% +13.5% ➖ noise
40 duckdb:vortex-compact +3.9% +4.5% -0.6% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -3.1% +4.5% -7.3% +11.3% ➖ noise
41 datafusion:vortex-compact +9.7% +7.9% +1.7% +13.8% ➖ noise
41 datafusion:vortex-file-compressed +19.7% +7.9% +10.9% +10.0% 🚨 regression
41 duckdb:duckdb +0.1% +7.9% -7.2% +10.0% ➖ noise
41 duckdb:vortex-compact -1.2% +7.9% -8.4% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -3.4% +7.9% -10.5% +10.0% ✅ faster
42 datafusion:vortex-compact +3.4% +11.7% -7.4% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +4.1% +11.7% -6.8% +10.0% ➖ noise
42 duckdb:duckdb +6.3% +11.7% -4.9% +15.5% ➖ noise
42 duckdb:vortex-compact -2.6% +11.7% -12.8% +12.2% ✅ faster
42 duckdb:vortex-file-compressed +2.7% +11.7% -8.0% +15.2% ➖ noise
43 datafusion:vortex-compact +10.0% +11.4% -1.3% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +7.5% +11.4% -3.5% +10.0% ➖ noise
43 duckdb:duckdb -1.3% +11.4% -11.4% +10.0% ✅ faster
43 duckdb:vortex-compact -1.2% +11.4% -11.3% +13.5% ➖ noise
43 duckdb:vortex-file-compressed +3.1% +11.4% -7.4% +10.0% ➖ noise
44 datafusion:vortex-compact +8.0% +10.1% -1.9% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +5.9% +10.1% -3.8% +10.0% ➖ noise
44 duckdb:duckdb -2.7% +10.1% -11.6% +11.9% ✅ faster
44 duckdb:vortex-compact +0.7% +10.1% -8.5% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -0.3% +10.1% -9.5% +10.5% ➖ noise
45 datafusion:vortex-compact +3.6% +3.9% -0.2% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +10.3% +3.9% +6.2% +10.0% ➖ noise
45 duckdb:duckdb -2.3% +3.9% -5.9% +10.6% ➖ noise
45 duckdb:vortex-compact +3.7% +3.9% -0.2% +14.1% ➖ noise
45 duckdb:vortex-file-compressed -4.4% +3.9% -7.9% +12.7% ➖ noise
46 datafusion:vortex-compact +7.0% +6.1% +0.9% +10.0% ➖ noise
46 datafusion:vortex-file-compressed +12.3% +6.1% +5.9% +10.0% ➖ noise
46 duckdb:duckdb -1.1% +6.1% -6.7% +10.0% ➖ noise
46 duckdb:vortex-compact +4.1% +6.1% -1.8% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +3.7% +6.1% -2.3% +10.0% ➖ noise
47 datafusion:vortex-compact +8.0% +6.2% +1.6% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +10.3% +6.2% +3.8% +10.0% ➖ noise
47 duckdb:duckdb +0.1% +6.2% -5.8% +10.0% ➖ noise
47 duckdb:vortex-compact -2.1% +6.2% -7.9% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +2.5% +6.2% -3.5% +10.0% ➖ noise
48 datafusion:vortex-compact +4.8% +7.0% -2.1% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +8.8% +7.0% +1.7% +10.0% ➖ noise
48 duckdb:duckdb +1.0% +7.0% -5.6% +10.0% ➖ noise
48 duckdb:vortex-compact +1.1% +7.0% -5.5% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +4.0% +7.0% -2.8% +12.8% ➖ noise
49 datafusion:vortex-compact +1.3% +5.8% -4.3% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +5.6% +5.8% -0.2% +10.0% ➖ noise
49 duckdb:duckdb +14.6% +5.8% +8.3% +17.4% ➖ noise
49 duckdb:vortex-compact -1.3% +5.8% -6.7% +10.0% ➖ noise
49 duckdb:vortex-file-compressed -2.0% +5.8% -7.4% +17.7% ➖ noise
50 datafusion:vortex-compact +5.8% +6.2% -0.3% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +10.1% +6.2% +3.7% +10.0% ➖ noise
50 duckdb:duckdb -1.3% +6.2% -7.1% +10.0% ➖ noise
50 duckdb:vortex-compact -2.1% +6.2% -7.9% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -0.8% +6.2% -6.6% +10.0% ➖ noise
51 datafusion:vortex-compact +7.9% +3.3% +4.5% +11.0% ➖ noise
51 datafusion:vortex-file-compressed +5.4% +3.3% +2.0% +10.0% ➖ noise
51 duckdb:duckdb -2.4% +3.3% -5.5% +10.1% ➖ noise
51 duckdb:vortex-compact +1.7% +3.3% -1.5% +16.6% ➖ noise
51 duckdb:vortex-file-compressed +4.4% +3.3% +1.1% +25.0% ➖ noise
52 datafusion:vortex-compact +5.3% +4.0% +1.2% +19.5% ➖ noise
52 datafusion:vortex-file-compressed +14.7% +4.0% +10.2% +14.3% ➖ noise
52 duckdb:duckdb -4.3% +4.0% -8.0% +22.1% ➖ noise
52 duckdb:vortex-compact -5.1% +4.0% -8.8% +17.2% ➖ noise
52 duckdb:vortex-file-compressed +3.6% +4.0% -0.5% +17.9% ➖ noise
53 datafusion:vortex-compact +10.8% +6.4% +4.1% +12.7% ➖ noise
53 datafusion:vortex-file-compressed +7.0% +6.4% +0.5% +13.4% ➖ noise
53 duckdb:duckdb -4.6% +6.4% -10.3% +15.4% ➖ noise
53 duckdb:vortex-compact -2.9% +6.4% -8.8% +13.3% ➖ noise
53 duckdb:vortex-file-compressed +4.7% +6.4% -1.6% +15.5% ➖ noise
54 datafusion:vortex-compact +4.8% +4.7% +0.1% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +1.3% +4.7% -3.3% +10.0% ➖ noise
54 duckdb:duckdb -4.3% +4.7% -8.6% +12.3% ➖ noise
54 duckdb:vortex-compact +2.0% +4.7% -2.6% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +2.2% +4.7% -2.4% +12.7% ➖ noise
55 datafusion:vortex-compact +10.1% +6.0% +3.8% +12.6% ➖ noise
55 datafusion:vortex-file-compressed +6.2% +6.0% +0.2% +12.2% ➖ noise
55 duckdb:duckdb -4.4% +6.0% -9.9% +17.4% ➖ noise
55 duckdb:vortex-compact -1.0% +6.0% -6.7% +11.4% ➖ noise
55 duckdb:vortex-file-compressed -3.9% +6.0% -9.4% +16.8% ➖ noise
56 datafusion:vortex-compact +5.7% +2.7% +2.9% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +9.6% +2.7% +6.7% +10.0% ➖ noise
56 duckdb:duckdb -3.1% +2.7% -5.7% +12.3% ➖ noise
56 duckdb:vortex-compact +0.6% +2.7% -2.0% +10.3% ➖ noise
56 duckdb:vortex-file-compressed +2.1% +2.7% -0.6% +10.0% ➖ noise
57 datafusion:vortex-compact +10.0% +2.0% +7.8% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +7.4% +2.0% +5.2% +10.0% ➖ noise
57 duckdb:duckdb -0.3% +2.0% -2.3% +11.2% ➖ noise
57 duckdb:vortex-compact -4.3% +2.0% -6.2% +17.1% ➖ noise
57 duckdb:vortex-file-compressed -0.9% +2.0% -2.9% +17.0% ➖ noise
58 datafusion:vortex-compact +8.4% +3.4% +4.9% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +8.8% +3.4% +5.3% +10.0% ➖ noise
58 duckdb:duckdb +6.5% +3.4% +3.1% +13.9% ➖ noise
58 duckdb:vortex-compact -1.1% +3.4% -4.4% +14.4% ➖ noise
58 duckdb:vortex-file-compressed -0.9% +3.4% -4.1% +23.3% ➖ noise
59 datafusion:vortex-compact +6.5% +1.0% +5.5% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +5.3% +1.0% +4.3% +10.0% ➖ noise
59 duckdb:duckdb -0.6% +1.0% -1.5% +10.0% ➖ noise
59 duckdb:vortex-compact -4.5% +1.0% -5.5% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -1.5% +1.0% -2.5% +10.0% ➖ noise
60 datafusion:vortex-compact +3.4% +4.5% -1.0% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +7.7% +4.5% +3.0% +10.0% ➖ noise
60 duckdb:duckdb -3.1% +4.5% -7.3% +10.0% ➖ noise
60 duckdb:vortex-compact +1.1% +4.5% -3.3% +10.0% ➖ noise
60 duckdb:vortex-file-compressed +10.4% +4.5% +5.7% +10.0% ➖ noise
61 datafusion:vortex-compact +4.7% +1.8% +2.8% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +6.7% +1.8% +4.8% +10.0% ➖ noise
61 duckdb:duckdb -3.2% +1.8% -5.0% +10.0% ➖ noise
61 duckdb:vortex-compact -3.6% +1.8% -5.4% +11.4% ➖ noise
61 duckdb:vortex-file-compressed -2.4% +1.8% -4.2% +10.0% ➖ noise
62 datafusion:vortex-compact +6.0% -0.8% +6.9% +12.5% ➖ noise
62 datafusion:vortex-file-compressed +8.9% -0.8% +9.8% +14.3% ➖ noise
62 duckdb:duckdb -3.5% -0.8% -2.7% +17.3% ➖ noise
62 duckdb:vortex-compact +1.8% -0.8% +2.6% +20.3% ➖ noise
62 duckdb:vortex-file-compressed -8.3% -0.8% -7.5% +25.6% ➖ noise
63 datafusion:vortex-compact +2.3% +3.5% -1.2% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +9.3% +3.5% +5.6% +10.0% ➖ noise
63 duckdb:duckdb -3.2% +3.5% -6.5% +11.8% ➖ noise
63 duckdb:vortex-compact +0.5% +3.5% -2.9% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +1.5% +3.5% -1.9% +10.0% ➖ noise
64 datafusion:vortex-compact +5.4% +3.6% +1.7% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +6.0% +3.6% +2.4% +10.0% ➖ noise
64 duckdb:duckdb -3.8% +3.6% -7.1% +10.0% ➖ noise
64 duckdb:vortex-compact +1.7% +3.6% -1.8% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +2.5% +3.6% -1.1% +10.0% ➖ noise
65 datafusion:vortex-compact +7.4% +3.7% +3.6% +11.7% ➖ noise
65 datafusion:vortex-file-compressed +7.6% +3.7% +3.7% +13.7% ➖ noise
65 duckdb:duckdb -5.4% +3.7% -8.8% +13.9% ➖ noise
65 duckdb:vortex-compact +0.7% +3.7% -2.9% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +0.0% +3.7% -3.6% +11.0% ➖ noise
66 datafusion:vortex-compact +7.7% +4.0% +3.6% +10.0% ➖ noise
66 datafusion:vortex-file-compressed +2.8% +4.0% -1.1% +10.0% ➖ noise
66 duckdb:duckdb -6.3% +4.0% -9.9% +13.7% ➖ noise
66 duckdb:vortex-compact +5.6% +4.0% +1.6% +10.0% ➖ noise
66 duckdb:vortex-file-compressed +10.1% +4.0% +5.9% +13.4% ➖ noise
67 datafusion:vortex-compact +4.4% +4.9% -0.5% +10.0% ➖ noise
67 datafusion:vortex-file-compressed +9.6% +4.9% +4.5% +10.0% ➖ noise
67 duckdb:duckdb -2.5% +4.9% -7.1% +10.0% ➖ noise
67 duckdb:vortex-compact -3.4% +4.9% -8.0% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +2.9% +4.9% -1.9% +10.0% ➖ noise
68 datafusion:vortex-compact +8.3% +3.7% +4.4% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +14.0% +3.7% +9.9% +10.0% ➖ noise
68 duckdb:duckdb -0.6% +3.7% -4.2% +10.0% ➖ noise
68 duckdb:vortex-compact -1.5% +3.7% -5.1% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +2.5% +3.7% -1.2% +10.0% ➖ noise
69 datafusion:vortex-compact +6.8% +4.0% +2.6% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +7.2% +4.0% +3.1% +10.0% ➖ noise
69 duckdb:duckdb -4.5% +4.0% -8.2% +10.5% ➖ noise
69 duckdb:vortex-compact -2.4% +4.0% -6.1% +14.1% ➖ noise
69 duckdb:vortex-file-compressed +1.2% +4.0% -2.7% +10.0% ➖ noise
70 datafusion:vortex-compact +5.4% +2.4% +2.9% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +7.7% +2.4% +5.2% +10.4% ➖ noise
70 duckdb:duckdb -0.3% +2.4% -2.6% +13.6% ➖ noise
70 duckdb:vortex-compact -1.1% +2.4% -3.4% +12.3% ➖ noise
70 duckdb:vortex-file-compressed -3.2% +2.4% -5.5% +12.5% ➖ noise
71 datafusion:vortex-compact +0.0% +2.0% -1.9% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +3.6% +2.0% +1.6% +10.0% ➖ noise
71 duckdb:duckdb -4.7% +2.0% -6.5% +10.6% ➖ noise
71 duckdb:vortex-compact +1.2% +2.0% -0.7% +13.0% ➖ noise
71 duckdb:vortex-file-compressed +0.4% +2.0% -1.5% +10.2% ➖ noise
72 datafusion:vortex-compact +4.8% +5.3% -0.4% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +8.8% +5.3% +3.3% +10.0% ➖ noise
72 duckdb:duckdb -0.5% +5.3% -5.5% +12.3% ➖ noise
72 duckdb:vortex-compact +1.6% +5.3% -3.5% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.4% +5.3% -5.4% +10.0% ➖ noise
73 datafusion:vortex-compact +2.5% +2.4% +0.1% +18.2% ➖ noise
73 datafusion:vortex-file-compressed +3.0% +2.4% +0.6% +18.7% ➖ noise
73 duckdb:duckdb -2.1% +2.4% -4.4% +12.0% ➖ noise
73 duckdb:vortex-compact -0.8% +2.4% -3.1% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +3.7% +2.4% +1.3% +10.0% ➖ noise
74 datafusion:vortex-compact +5.3% +5.3% +0.0% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +8.0% +5.3% +2.5% +10.0% ➖ noise
74 duckdb:duckdb -2.4% +5.3% -7.3% +10.0% ➖ noise
74 duckdb:vortex-compact +0.2% +5.3% -4.9% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +7.4% +5.3% +2.0% +10.0% ➖ noise
75 datafusion:vortex-compact +1.8% +2.5% -0.7% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +7.7% +2.5% +5.1% +10.0% ➖ noise
75 duckdb:duckdb -1.4% +2.5% -3.8% +10.0% ➖ noise
75 duckdb:vortex-compact -2.2% +2.5% -4.6% +10.0% ➖ noise
75 duckdb:vortex-file-compressed +0.4% +2.5% -2.1% +10.0% ➖ noise
76 datafusion:vortex-compact +4.7% +10.6% -5.3% +10.0% ➖ noise
76 datafusion:vortex-file-compressed +11.8% +10.6% +1.1% +10.0% ➖ noise
76 duckdb:duckdb -4.5% +10.6% -13.6% +13.2% ✅ faster
76 duckdb:vortex-compact +4.4% +10.6% -5.5% +10.7% ➖ noise
76 duckdb:vortex-file-compressed -11.5% +10.6% -19.9% +33.1% ➖ noise
77 datafusion:vortex-compact +4.5% +1.9% +2.5% +10.0% ➖ noise
77 datafusion:vortex-file-compressed +5.0% +1.9% +3.0% +10.0% ➖ noise
77 duckdb:duckdb +2.7% +1.9% +0.7% +11.7% ➖ noise
77 duckdb:vortex-compact +6.4% +1.9% +4.4% +10.0% ➖ noise
77 duckdb:vortex-file-compressed +5.7% +1.9% +3.7% +12.8% ➖ noise
78 datafusion:vortex-compact +4.3% +7.5% -3.0% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +8.5% +7.5% +0.9% +10.0% ➖ noise
78 duckdb:duckdb +3.4% +7.5% -3.9% +12.1% ➖ noise
78 duckdb:vortex-compact +0.5% +7.5% -6.6% +10.4% ➖ noise
78 duckdb:vortex-file-compressed -2.6% +7.5% -9.4% +10.0% ✅ faster
79 datafusion:vortex-compact +2.6% +3.1% -0.5% +10.5% ➖ noise
79 datafusion:vortex-file-compressed +10.8% +3.1% +7.4% +10.0% ➖ noise
79 duckdb:duckdb -0.5% +3.1% -3.5% +10.0% ➖ noise
79 duckdb:vortex-compact +7.1% +3.1% +3.9% +10.2% ➖ noise
79 duckdb:vortex-file-compressed -1.7% +3.1% -4.6% +16.2% ➖ noise
80 datafusion:vortex-compact +2.9% +6.7% -3.6% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +8.8% +6.7% +2.0% +10.0% ➖ noise
80 duckdb:duckdb -4.9% +6.7% -10.8% +15.7% ➖ noise
80 duckdb:vortex-compact -1.6% +6.7% -7.8% +10.0% ➖ noise
80 duckdb:vortex-file-compressed +6.1% +6.7% -0.6% +10.0% ➖ noise
81 datafusion:vortex-compact +7.5% +3.8% +3.6% +10.0% ➖ noise
81 datafusion:vortex-file-compressed +10.5% +3.8% +6.5% +17.4% ➖ noise
81 duckdb:duckdb -6.0% +3.8% -9.4% +10.0% ✅ faster
81 duckdb:vortex-compact -6.3% +3.8% -9.7% +10.0% ✅ faster
81 duckdb:vortex-file-compressed -1.5% +3.8% -5.1% +10.0% ➖ noise
82 datafusion:vortex-compact +2.7% +5.0% -2.2% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +5.9% +5.0% +0.8% +10.4% ➖ noise
82 duckdb:duckdb -2.4% +5.0% -7.1% +14.2% ➖ noise
82 duckdb:vortex-compact -3.2% +5.0% -7.9% +10.0% ➖ noise
82 duckdb:vortex-file-compressed -0.7% +5.0% -5.4% +13.5% ➖ noise
83 datafusion:vortex-compact +4.6% +4.7% -0.0% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +3.6% +4.7% -1.1% +10.0% ➖ noise
83 duckdb:duckdb -3.4% +4.7% -7.7% +10.0% ➖ noise
83 duckdb:vortex-compact -2.4% +4.7% -6.8% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +3.1% +4.7% -1.5% +14.6% ➖ noise
84 datafusion:vortex-compact +2.8% +3.0% -0.2% +12.2% ➖ noise
84 datafusion:vortex-file-compressed +9.8% +3.0% +6.6% +11.2% ➖ noise
84 duckdb:duckdb +2.4% +3.0% -0.6% +18.6% ➖ noise
84 duckdb:vortex-compact -2.7% +3.0% -5.6% +10.0% ➖ noise
84 duckdb:vortex-file-compressed -0.8% +3.0% -3.7% +10.0% ➖ noise
85 datafusion:vortex-compact +2.3% +7.5% -4.8% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +7.0% +7.5% -0.4% +10.0% ➖ noise
85 duckdb:duckdb -10.2% +7.5% -16.5% +16.9% ✅ faster
85 duckdb:vortex-compact -0.1% +7.5% -7.0% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +3.1% +7.5% -4.1% +10.0% ➖ noise
86 datafusion:vortex-compact +10.4% +3.6% +6.5% +10.0% ➖ noise
86 datafusion:vortex-file-compressed +8.8% +3.6% +5.0% +14.5% ➖ noise
86 duckdb:duckdb -0.3% +3.6% -3.8% +18.3% ➖ noise
86 duckdb:vortex-compact -6.1% +3.6% -9.4% +22.9% ➖ noise
86 duckdb:vortex-file-compressed -3.5% +3.6% -6.9% +18.1% ➖ noise
87 datafusion:vortex-compact +4.6% +10.8% -5.6% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +1.3% +10.8% -8.6% +10.0% ➖ noise
87 duckdb:duckdb -1.8% +10.8% -11.4% +10.1% ✅ faster
87 duckdb:vortex-compact +4.1% +10.8% -6.0% +10.0% ➖ noise
87 duckdb:vortex-file-compressed -6.5% +10.8% -15.6% +15.7% ✅ faster
88 datafusion:vortex-compact +1.7% +5.4% -3.5% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +7.1% +5.4% +1.6% +10.0% ➖ noise
88 duckdb:duckdb -0.2% +5.4% -5.3% +10.0% ➖ noise
88 duckdb:vortex-compact -1.1% +5.4% -6.2% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +0.7% +5.4% -4.5% +10.0% ➖ noise
89 datafusion:vortex-compact -0.1% +6.7% -6.4% +10.0% ➖ noise
89 datafusion:vortex-file-compressed +5.0% +6.7% -1.6% +10.7% ➖ noise
89 duckdb:duckdb -1.6% +6.7% -7.8% +11.9% ➖ noise
89 duckdb:vortex-compact +0.8% +6.7% -5.5% +10.0% ➖ noise
89 duckdb:vortex-file-compressed -1.7% +6.7% -7.9% +10.9% ➖ noise
90 datafusion:vortex-compact +3.5% +8.4% -4.6% +12.4% ➖ noise
90 datafusion:vortex-file-compressed +3.7% +8.4% -4.4% +10.0% ➖ noise
90 duckdb:duckdb -4.6% +8.4% -12.0% +10.5% ✅ faster
90 duckdb:vortex-compact -0.5% +8.4% -8.2% +10.0% ➖ noise
90 duckdb:vortex-file-compressed +2.5% +8.4% -5.4% +10.8% ➖ noise
91 datafusion:vortex-compact +0.8% +1.7% -0.9% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +9.0% +1.7% +7.2% +10.0% ➖ noise
91 duckdb:duckdb -7.9% +1.7% -9.4% +14.0% ➖ noise
91 duckdb:vortex-compact +1.5% +1.7% -0.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -0.5% +1.7% -2.1% +10.9% ➖ noise
92 datafusion:vortex-compact +5.4% +6.6% -1.1% +10.0% ➖ noise
92 datafusion:vortex-file-compressed +11.5% +6.6% +4.6% +10.0% ➖ noise
92 duckdb:duckdb +8.0% +6.6% +1.3% +18.3% ➖ noise
92 duckdb:vortex-compact -1.1% +6.6% -7.3% +16.4% ➖ noise
92 duckdb:vortex-file-compressed +4.4% +6.6% -2.1% +10.0% ➖ noise
93 datafusion:vortex-compact +4.7% +5.9% -1.1% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +10.4% +5.9% +4.3% +10.0% ➖ noise
93 duckdb:duckdb +4.8% +5.9% -1.0% +10.7% ➖ noise
93 duckdb:vortex-compact +3.9% +5.9% -1.9% +18.4% ➖ noise
93 duckdb:vortex-file-compressed +2.6% +5.9% -3.1% +16.1% ➖ noise
94 datafusion:vortex-compact +1.1% +2.0% -0.9% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +7.8% +2.0% +5.6% +10.0% ➖ noise
94 duckdb:duckdb -1.4% +2.0% -3.3% +10.1% ➖ noise
94 duckdb:vortex-compact -0.3% +2.0% -2.3% +12.8% ➖ noise
94 duckdb:vortex-file-compressed +7.2% +2.0% +5.1% +10.0% ➖ noise
95 datafusion:vortex-compact -2.0% +7.9% -9.2% +11.3% ➖ noise
95 datafusion:vortex-file-compressed +6.0% +7.9% -1.8% +10.2% ➖ noise
95 duckdb:duckdb +20.1% +7.9% +11.3% +18.4% ➖ noise
95 duckdb:vortex-compact +3.4% +7.9% -4.2% +14.8% ➖ noise
95 duckdb:vortex-file-compressed -1.6% +7.9% -8.8% +16.5% ➖ noise
96 datafusion:vortex-compact +3.4% +8.4% -4.6% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +6.2% +8.4% -2.1% +10.0% ➖ noise
96 duckdb:duckdb +1.6% +8.4% -6.3% +14.6% ➖ noise
96 duckdb:vortex-compact +3.4% +8.4% -4.6% +12.1% ➖ noise
96 duckdb:vortex-file-compressed -1.5% +8.4% -9.2% +10.5% ➖ noise
97 datafusion:vortex-compact +4.4% +8.6% -3.8% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +2.5% +8.6% -5.6% +10.0% ➖ noise
97 duckdb:duckdb -0.9% +8.6% -8.7% +12.4% ➖ noise
97 duckdb:vortex-compact +3.9% +8.6% -4.3% +19.3% ➖ noise
97 duckdb:vortex-file-compressed +2.0% +8.6% -6.1% +10.0% ➖ noise
98 datafusion:vortex-compact +5.7% +7.0% -1.2% +11.2% ➖ noise
98 datafusion:vortex-file-compressed +6.9% +7.0% -0.2% +10.0% ➖ noise
98 duckdb:duckdb +0.6% +7.0% -6.0% +13.9% ➖ noise
98 duckdb:vortex-compact +1.1% +7.0% -5.5% +10.8% ➖ noise
98 duckdb:vortex-file-compressed -0.4% +7.0% -6.9% +11.6% ➖ noise
99 datafusion:vortex-compact +0.3% +4.9% -4.4% +14.6% ➖ noise
99 datafusion:vortex-file-compressed +1.8% +4.9% -3.0% +13.2% ➖ noise
99 duckdb:duckdb -2.6% +4.9% -7.1% +38.6% ➖ noise
99 duckdb:vortex-compact +11.3% +4.9% +6.1% +20.3% ➖ noise
99 duckdb:vortex-file-compressed +0.7% +4.9% -4.0% +12.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 1.001x ➖
Parquet (geomean): 1.003x ➖
Shifts: Parquet (control) +0.3% · Median polish -0.1%

datafusion / vortex-file-compressed (1.010x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 408538093 390309259 1.05
tpch_q02/datafusion:vortex-file-compressed 115460259 114666397 1.01
tpch_q03/datafusion:vortex-file-compressed 206039778 204408955 1.01
tpch_q04/datafusion:vortex-file-compressed 103785332 98638967 1.05
tpch_q05/datafusion:vortex-file-compressed 391351927 382087646 1.02
tpch_q06/datafusion:vortex-file-compressed 40549474 41013480 0.99
tpch_q07/datafusion:vortex-file-compressed 563975633 563156317 1.00
tpch_q08/datafusion:vortex-file-compressed 376313433 377622775 1.00
tpch_q09/datafusion:vortex-file-compressed 671223603 667417018 1.01
tpch_q10/datafusion:vortex-file-compressed 237916161 241364198 0.99
tpch_q11/datafusion:vortex-file-compressed 87478612 84527052 1.03
tpch_q12/datafusion:vortex-file-compressed 108291161 110861511 0.98
tpch_q13/datafusion:vortex-file-compressed 222369961 223584152 0.99
tpch_q14/datafusion:vortex-file-compressed 58205335 59411432 0.98
tpch_q15/datafusion:vortex-file-compressed 108608323 108970067 1.00
tpch_q16/datafusion:vortex-file-compressed 77944883 75683440 1.03
tpch_q17/datafusion:vortex-file-compressed 645415604 644830080 1.00
tpch_q18/datafusion:vortex-file-compressed 885812691 876472174 1.01
tpch_q19/datafusion:vortex-file-compressed 120126955 117137318 1.03
tpch_q20/datafusion:vortex-file-compressed 171317682 168583975 1.02
tpch_q21/datafusion:vortex-file-compressed 669901214 659665914 1.02
tpch_q22/datafusion:vortex-file-compressed 63879637 62401307 1.02
datafusion / vortex-compact (1.006x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 450570979 439810456 1.02
tpch_q02/datafusion:vortex-compact 121816660 122867821 0.99
tpch_q03/datafusion:vortex-compact 216929104 217713272 1.00
tpch_q04/datafusion:vortex-compact 121724906 122396655 0.99
tpch_q05/datafusion:vortex-compact 391851981 393343698 1.00
tpch_q06/datafusion:vortex-compact 64784172 64464663 1.00
tpch_q07/datafusion:vortex-compact 588889082 592757783 0.99
tpch_q08/datafusion:vortex-compact 393078792 388220048 1.01
tpch_q09/datafusion:vortex-compact 688215480 680405770 1.01
tpch_q10/datafusion:vortex-compact 277387991 277434270 1.00
tpch_q11/datafusion:vortex-compact 90103581 92429736 0.97
tpch_q12/datafusion:vortex-compact 170061214 171911142 0.99
tpch_q13/datafusion:vortex-compact 274531905 272103122 1.01
tpch_q14/datafusion:vortex-compact 76519004 76139889 1.00
tpch_q15/datafusion:vortex-compact 166741567 166347596 1.00
tpch_q16/datafusion:vortex-compact 83956357 80939928 1.04
tpch_q17/datafusion:vortex-compact 653384775 648305900 1.01
tpch_q18/datafusion:vortex-compact 893985497 895354576 1.00
tpch_q19/datafusion:vortex-compact 221684504 207098797 1.07
tpch_q20/datafusion:vortex-compact 198836208 199185995 1.00
tpch_q21/datafusion:vortex-compact 703340456 699841177 1.01
tpch_q22/datafusion:vortex-compact 74005035 73318132 1.01
datafusion / parquet (1.005x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 418111531 417571751 1.00
tpch_q02/datafusion:parquet 190559916 185942128 1.02
tpch_q03/datafusion:parquet 297277366 292542264 1.02
tpch_q04/datafusion:parquet 133982367 132184714 1.01
tpch_q05/datafusion:parquet 452430668 440276201 1.03
tpch_q06/datafusion:parquet 121626019 120310883 1.01
tpch_q07/datafusion:parquet 627310739 628607885 1.00
tpch_q08/datafusion:parquet 492103520 483599664 1.02
tpch_q09/datafusion:parquet 761292284 765347619 0.99
tpch_q10/datafusion:parquet 506549503 509763540 0.99
tpch_q11/datafusion:parquet 131179933 132587644 0.99
tpch_q12/datafusion:parquet 209376789 213875038 0.98
tpch_q13/datafusion:parquet 336983529 336262117 1.00
tpch_q14/datafusion:parquet 154901504 153343147 1.01
tpch_q15/datafusion:parquet 243269833 250342019 0.97
tpch_q16/datafusion:parquet 137991681 133782326 1.03
tpch_q17/datafusion:parquet 694902257 683474690 1.02
tpch_q18/datafusion:parquet 891114673 879965001 1.01
tpch_q19/datafusion:parquet 267650999 269183534 0.99
tpch_q20/datafusion:parquet 309449287 307102940 1.01
tpch_q21/datafusion:parquet 734831195 733051647 1.00
tpch_q22/datafusion:parquet 218828275 218868002 1.00
datafusion / arrow (1.004x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 602835046 597689104 1.01
tpch_q02/datafusion:arrow 168941438 170298558 0.99
tpch_q03/datafusion:arrow 468024070 457265920 1.02
tpch_q04/datafusion:arrow 354020965 341874759 1.04
tpch_q05/datafusion:arrow 930313749 917298793 1.01
tpch_q06/datafusion:arrow 271640690 272649307 1.00
tpch_q07/datafusion:arrow 1153004803 1136649764 1.01
tpch_q08/datafusion:arrow 1132502056 1134770122 1.00
tpch_q09/datafusion:arrow 1330778559 1335932833 1.00
tpch_q10/datafusion:arrow 602499816 609133812 0.99
tpch_q11/datafusion:arrow 150142134 149524781 1.00
tpch_q12/datafusion:arrow 668264812 683606364 0.98
tpch_q13/datafusion:arrow 519404557 526956394 0.99
tpch_q14/datafusion:arrow 315657124 312829922 1.01
tpch_q15/datafusion:arrow 677906397 667999302 1.01
tpch_q16/datafusion:arrow 109222302 109271755 1.00
tpch_q17/datafusion:arrow 1326747262 1330248246 1.00
tpch_q18/datafusion:arrow 1831070424 1783238645 1.03
tpch_q19/datafusion:arrow 501196169 507893448 0.99
tpch_q20/datafusion:arrow 496321406 482825624 1.03
tpch_q21/datafusion:arrow 2822084840 2858908743 0.99
tpch_q22/datafusion:arrow 145432145 144248599 1.01
duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 178150587 177623088 1.00
tpch_q02/duckdb:vortex-file-compressed 52132880 52381075 1.00
tpch_q03/duckdb:vortex-file-compressed 130231399 129449914 1.01
tpch_q04/duckdb:vortex-file-compressed 151496153 150487433 1.01
tpch_q05/duckdb:vortex-file-compressed 133843305 131049934 1.02
tpch_q06/duckdb:vortex-file-compressed 48427545 50335447 0.96
tpch_q07/duckdb:vortex-file-compressed 146474518 148632529 0.99
tpch_q08/duckdb:vortex-file-compressed 181147955 176515225 1.03
tpch_q09/duckdb:vortex-file-compressed 334837177 335885904 1.00
tpch_q10/duckdb:vortex-file-compressed 152992466 156512168 0.98
tpch_q11/duckdb:vortex-file-compressed 35056005 36623408 0.96
tpch_q12/duckdb:vortex-file-compressed 91868696 97068810 0.95
tpch_q13/duckdb:vortex-file-compressed 249640660 250907214 0.99
tpch_q14/duckdb:vortex-file-compressed 69805182 73441545 0.95
tpch_q15/duckdb:vortex-file-compressed 97304773 96948553 1.00
tpch_q16/duckdb:vortex-file-compressed 78986837 79984343 0.99
tpch_q17/duckdb:vortex-file-compressed 103247373 103113602 1.00
tpch_q18/duckdb:vortex-file-compressed 284526412 280752632 1.01
tpch_q19/duckdb:vortex-file-compressed 89589357 93220034 0.96
tpch_q20/duckdb:vortex-file-compressed 166605919 168254853 0.99
tpch_q21/duckdb:vortex-file-compressed 557920788 559435594 1.00
tpch_q22/duckdb:vortex-file-compressed 77010651 79701166 0.97
duckdb / vortex-compact (0.999x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 231593835 231251981 1.00
tpch_q02/duckdb:vortex-compact 59112470 60016087 0.98
tpch_q03/duckdb:vortex-compact 143236523 140103757 1.02
tpch_q04/duckdb:vortex-compact 181808239 173891689 1.05
tpch_q05/duckdb:vortex-compact 150495097 148344550 1.01
tpch_q06/duckdb:vortex-compact 86507535 86884915 1.00
tpch_q07/duckdb:vortex-compact 207897005 205897267 1.01
tpch_q08/duckdb:vortex-compact 193405996 198538503 0.97
tpch_q09/duckdb:vortex-compact 365983044 366355336 1.00
tpch_q10/duckdb:vortex-compact 190989959 191563405 1.00
tpch_q11/duckdb:vortex-compact 42344176 42402823 1.00
tpch_q12/duckdb:vortex-compact 210191414 210864483 1.00
tpch_q13/duckdb:vortex-compact 301300150 300752115 1.00
tpch_q14/duckdb:vortex-compact 104115444 104859353 0.99
tpch_q15/duckdb:vortex-compact 119071995 119301038 1.00
tpch_q16/duckdb:vortex-compact 87068216 88767483 0.98
tpch_q17/duckdb:vortex-compact 118744929 119893550 0.99
tpch_q18/duckdb:vortex-compact 293875819 296588436 0.99
tpch_q19/duckdb:vortex-compact 117632564 119211034 0.99
tpch_q20/duckdb:vortex-compact 209966817 208484120 1.01
tpch_q21/duckdb:vortex-compact 631810190 640665896 0.99
tpch_q22/duckdb:vortex-compact 92225944 92167053 1.00
duckdb / parquet (1.000x ➖, 1↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 257603299 260051524 0.99
tpch_q02/duckdb:parquet 104856315 97385046 1.08
tpch_q03/duckdb:parquet 211725875 213934760 0.99
tpch_q04/duckdb:parquet 135104307 134992658 1.00
tpch_q05/duckdb:parquet 219990838 221703579 0.99
tpch_q06/duckdb:parquet 67997140 66126340 1.03
tpch_q07/duckdb:parquet 182890722 180583138 1.01
tpch_q08/duckdb:parquet 255888138 257367283 0.99
tpch_q09/duckdb:parquet 459076216 465611368 0.99
tpch_q10/duckdb:parquet 612218916 608878444 1.01
tpch_q11/duckdb:parquet 43869929 40728541 1.08
tpch_q12/duckdb:parquet 127009368 128436964 0.99
tpch_q13/duckdb:parquet 🚀 404429381 457903108 0.88
tpch_q14/duckdb:parquet 176082420 178158207 0.99
tpch_q15/duckdb:parquet 95351091 99708065 0.96
tpch_q16/duckdb:parquet 156952402 164995916 0.95
tpch_q17/duckdb:parquet 177784469 174715284 1.02
tpch_q18/duckdb:parquet 348745100 350245353 1.00
tpch_q19/duckdb:parquet 296127882 280543231 1.06
tpch_q20/duckdb:parquet 234458169 229119198 1.02
tpch_q21/duckdb:parquet 571891298 567433869 1.01
tpch_q22/duckdb:parquet 291106723 292896928 0.99
duckdb / duckdb (0.995x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116896997 117557723 0.99
tpch_q02/duckdb:duckdb 49468963 48756871 1.01
tpch_q03/duckdb:duckdb 97509894 97138762 1.00
tpch_q04/duckdb:duckdb 132927394 133832999 0.99
tpch_q05/duckdb:duckdb 109636730 110647875 0.99
tpch_q06/duckdb:duckdb 40032389 39475493 1.01
tpch_q07/duckdb:duckdb 86138069 86731616 0.99
tpch_q08/duckdb:duckdb 110231506 110899075 0.99
tpch_q09/duckdb:duckdb 274932365 279965138 0.98
tpch_q10/duckdb:duckdb 205859126 206794981 1.00
tpch_q11/duckdb:duckdb 15024306 15699284 0.96
tpch_q12/duckdb:duckdb 84034009 83567429 1.01
tpch_q13/duckdb:duckdb 253571944 250799514 1.01
tpch_q14/duckdb:duckdb 70938742 72400963 0.98
tpch_q15/duckdb:duckdb 78909559 79752083 0.99
tpch_q16/duckdb:duckdb 72749148 72733367 1.00
tpch_q17/duckdb:duckdb 84617028 85546777 0.99
tpch_q18/duckdb:duckdb 212797351 214105023 0.99
tpch_q19/duckdb:duckdb 116424152 116380885 1.00
tpch_q20/duckdb:duckdb 110701871 111723165 0.99
tpch_q21/duckdb:duckdb 298124143 305890116 0.97
tpch_q22/duckdb:duckdb 69932587 67851549 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +0.9% -0.4% +1.3% +10.4% ➖ noise
1 datafusion:vortex-compact +2.4% -0.4% +2.9% +12.6% ➖ noise
1 datafusion:vortex-file-compressed +4.7% -0.4% +5.1% +12.7% ➖ noise
1 duckdb:duckdb -0.6% -0.4% -0.2% +10.4% ➖ noise
1 duckdb:vortex-compact +0.1% -0.4% +0.6% +10.2% ➖ noise
1 duckdb:vortex-file-compressed +0.3% -0.4% +0.7% +11.0% ➖ noise
2 datafusion:arrow -0.8% +5.0% -5.6% +10.0% ➖ noise
2 datafusion:vortex-compact -0.9% +5.0% -5.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +0.7% +5.0% -4.1% +10.0% ➖ noise
2 duckdb:duckdb +1.5% +5.0% -3.4% +12.9% ➖ noise
2 duckdb:vortex-compact -1.5% +5.0% -6.2% +10.7% ➖ noise
2 duckdb:vortex-file-compressed -0.5% +5.0% -5.3% +10.0% ➖ noise
3 datafusion:arrow +2.4% +0.3% +2.1% +10.0% ➖ noise
3 datafusion:vortex-compact -0.4% +0.3% -0.6% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.8% +0.3% +0.5% +10.0% ➖ noise
3 duckdb:duckdb +0.4% +0.3% +0.1% +10.0% ➖ noise
3 duckdb:vortex-compact +2.2% +0.3% +1.9% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.6% +0.3% +0.3% +10.0% ➖ noise
4 datafusion:arrow +3.6% +0.7% +2.8% +10.0% ➖ noise
4 datafusion:vortex-compact -0.5% +0.7% -1.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +5.2% +0.7% +4.5% +10.0% ➖ noise
4 duckdb:duckdb -0.7% +0.7% -1.4% +10.0% ➖ noise
4 duckdb:vortex-compact +4.6% +0.7% +3.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.7% +0.7% -0.0% +10.0% ➖ noise
5 datafusion:arrow +1.4% +1.0% +0.4% +10.0% ➖ noise
5 datafusion:vortex-compact -0.4% +1.0% -1.3% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +2.4% +1.0% +1.4% +10.0% ➖ noise
5 duckdb:duckdb -0.9% +1.0% -1.9% +10.0% ➖ noise
5 duckdb:vortex-compact +1.4% +1.0% +0.5% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.1% +1.0% +1.1% +10.0% ➖ noise
6 datafusion:arrow -0.4% +2.0% -2.3% +10.0% ➖ noise
6 datafusion:vortex-compact +0.5% +2.0% -1.4% +11.5% ➖ noise
6 datafusion:vortex-file-compressed -1.1% +2.0% -3.0% +10.0% ➖ noise
6 duckdb:duckdb +1.4% +2.0% -0.5% +15.5% ➖ noise
6 duckdb:vortex-compact -0.4% +2.0% -2.3% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -3.8% +2.0% -5.6% +10.0% ➖ noise
7 datafusion:arrow +1.4% +0.5% +0.9% +10.0% ➖ noise
7 datafusion:vortex-compact -0.7% +0.5% -1.2% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +0.1% +0.5% -0.4% +10.0% ➖ noise
7 duckdb:duckdb -0.7% +0.5% -1.2% +10.0% ➖ noise
7 duckdb:vortex-compact +1.0% +0.5% +0.4% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.5% +0.5% -2.0% +10.0% ➖ noise
8 datafusion:arrow -0.2% +0.6% -0.8% +10.0% ➖ noise
8 datafusion:vortex-compact +1.3% +0.6% +0.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -0.3% +0.6% -0.9% +10.0% ➖ noise
8 duckdb:duckdb -0.6% +0.6% -1.2% +10.0% ➖ noise
8 duckdb:vortex-compact -2.6% +0.6% -3.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +2.6% +0.6% +2.0% +10.0% ➖ noise
9 datafusion:arrow -0.4% -1.0% +0.6% +10.0% ➖ noise
9 datafusion:vortex-compact +1.1% -1.0% +2.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.6% -1.0% +1.6% +10.0% ➖ noise
9 duckdb:duckdb -1.8% -1.0% -0.8% +10.0% ➖ noise
9 duckdb:vortex-compact -0.1% -1.0% +0.9% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.3% -1.0% +0.7% +10.0% ➖ noise
10 datafusion:arrow -1.1% -0.0% -1.0% +10.0% ➖ noise
10 datafusion:vortex-compact -0.0% -0.0% +0.0% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.4% -0.0% -1.4% +10.0% ➖ noise
10 duckdb:duckdb -0.5% -0.0% -0.4% +10.0% ➖ noise
10 duckdb:vortex-compact -0.3% -0.0% -0.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -2.2% -0.0% -2.2% +10.0% ➖ noise
11 datafusion:arrow +0.4% +3.2% -2.7% +10.8% ➖ noise
11 datafusion:vortex-compact -2.5% +3.2% -5.6% +11.7% ➖ noise
11 datafusion:vortex-file-compressed +3.5% +3.2% +0.3% +12.1% ➖ noise
11 duckdb:duckdb -4.3% +3.2% -7.3% +18.8% ➖ noise
11 duckdb:vortex-compact -0.1% +3.2% -3.3% +12.9% ➖ noise
11 duckdb:vortex-file-compressed -4.3% +3.2% -7.3% +15.1% ➖ noise
12 datafusion:arrow -2.2% -1.6% -0.6% +43.3% ➖ noise
12 datafusion:vortex-compact -1.1% -1.6% +0.5% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.3% -1.6% -0.7% +10.0% ➖ noise
12 duckdb:duckdb +0.6% -1.6% +2.2% +10.0% ➖ noise
12 duckdb:vortex-compact -0.3% -1.6% +1.3% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.4% -1.6% -3.8% +10.0% ➖ noise
13 datafusion:arrow -1.4% -5.9% +4.8% +10.0% ➖ noise
13 datafusion:vortex-compact +0.9% -5.9% +7.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -0.5% -5.9% +5.7% +10.0% ➖ noise
13 duckdb:duckdb +1.1% -5.9% +7.5% +10.0% ➖ noise
13 duckdb:vortex-compact +0.2% -5.9% +6.5% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -0.5% -5.9% +5.8% +10.0% ➖ noise
14 datafusion:arrow +0.9% -0.1% +1.0% +10.0% ➖ noise
14 datafusion:vortex-compact +0.5% -0.1% +0.6% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -2.0% -0.1% -2.0% +12.1% ➖ noise
14 duckdb:duckdb -2.0% -0.1% -1.9% +10.0% ➖ noise
14 duckdb:vortex-compact -0.7% -0.1% -0.6% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -5.0% -0.1% -4.9% +10.2% ➖ noise
15 datafusion:arrow +1.5% -3.6% +5.3% +10.0% ➖ noise
15 datafusion:vortex-compact +0.2% -3.6% +4.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.3% -3.6% +3.4% +10.0% ➖ noise
15 duckdb:duckdb -1.1% -3.6% +2.6% +10.0% ➖ noise
15 duckdb:vortex-compact -0.2% -3.6% +3.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.4% -3.6% +4.1% +10.0% ➖ noise
16 datafusion:arrow -0.0% -0.9% +0.9% +10.0% ➖ noise
16 datafusion:vortex-compact +3.7% -0.9% +4.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +3.0% -0.9% +4.0% +10.0% ➖ noise
16 duckdb:duckdb +0.0% -0.9% +1.0% +10.0% ➖ noise
16 duckdb:vortex-compact -1.9% -0.9% -1.0% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -1.2% -0.9% -0.3% +10.0% ➖ noise
17 datafusion:arrow -0.3% +1.7% -1.9% +10.0% ➖ noise
17 datafusion:vortex-compact +0.8% +1.7% -0.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +0.1% +1.7% -1.6% +10.0% ➖ noise
17 duckdb:duckdb -1.1% +1.7% -2.8% +10.0% ➖ noise
17 duckdb:vortex-compact -1.0% +1.7% -2.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed +0.1% +1.7% -1.6% +10.0% ➖ noise
18 datafusion:arrow +2.7% +0.4% +2.3% +10.0% ➖ noise
18 datafusion:vortex-compact -0.2% +0.4% -0.6% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +1.1% +0.4% +0.6% +10.0% ➖ noise
18 duckdb:duckdb -0.6% +0.4% -1.0% +10.0% ➖ noise
18 duckdb:vortex-compact -0.9% +0.4% -1.3% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +1.3% +0.4% +0.9% +10.0% ➖ noise
19 datafusion:arrow -1.3% +2.4% -3.7% +10.0% ➖ noise
19 datafusion:vortex-compact +7.0% +2.4% +4.5% +11.9% ➖ noise
19 datafusion:vortex-file-compressed +2.6% +2.4% +0.1% +10.0% ➖ noise
19 duckdb:duckdb +0.0% +2.4% -2.4% +10.0% ➖ noise
19 duckdb:vortex-compact -1.3% +2.4% -3.7% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -3.9% +2.4% -6.2% +10.0% ➖ noise
20 datafusion:arrow +2.8% +1.5% +1.2% +10.0% ➖ noise
20 datafusion:vortex-compact -0.2% +1.5% -1.7% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +1.6% +1.5% +0.1% +10.0% ➖ noise
20 duckdb:duckdb -0.9% +1.5% -2.4% +10.0% ➖ noise
20 duckdb:vortex-compact +0.7% +1.5% -0.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -1.0% +1.5% -2.5% +10.0% ➖ noise
21 datafusion:arrow -1.3% +0.5% -1.8% +10.0% ➖ noise
21 datafusion:vortex-compact +0.5% +0.5% -0.0% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.6% +0.5% +1.0% +10.0% ➖ noise
21 duckdb:duckdb -2.5% +0.5% -3.0% +10.0% ➖ noise
21 duckdb:vortex-compact -1.4% +0.5% -1.9% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -0.3% +0.5% -0.8% +10.0% ➖ noise
22 datafusion:arrow +0.8% -0.3% +1.1% +10.0% ➖ noise
22 datafusion:vortex-compact +0.9% -0.3% +1.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +2.4% -0.3% +2.7% +10.0% ➖ noise
22 duckdb:duckdb +3.1% -0.3% +3.4% +10.9% ➖ noise
22 duckdb:vortex-compact +0.1% -0.3% +0.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -3.4% -0.3% -3.1% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.3%
Vortex (geomean): 1.017x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish -0.1%

duckdb / vortex-file-compressed (1.030x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 10831732 10784148 1.00
statpopgen_q01/duckdb:vortex-file-compressed 🚨 27135277 18485023 1.47
statpopgen_q02/duckdb:vortex-file-compressed 1286395065 1275162985 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3028620652 3053000153 0.99
statpopgen_q04/duckdb:vortex-file-compressed 3054869956 3046493275 1.00
statpopgen_q05/duckdb:vortex-file-compressed 1369452694 1384194651 0.99
statpopgen_q06/duckdb:vortex-file-compressed 2057044362 2058906986 1.00
statpopgen_q07/duckdb:vortex-file-compressed 203225804 212197097 0.96
statpopgen_q08/duckdb:vortex-file-compressed 221403583 221366401 1.00
statpopgen_q09/duckdb:vortex-file-compressed 2888887000 2867504127 1.01
statpopgen_q10/duckdb:vortex-file-compressed 4574557718 4640414104 0.99
duckdb / vortex-compact (1.004x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 10909903 10667523 1.02
statpopgen_q01/duckdb:vortex-compact 167540116 167901022 1.00
statpopgen_q02/duckdb:vortex-compact 1805714543 1802876617 1.00
statpopgen_q03/duckdb:vortex-compact 3453356033 3497351090 0.99
statpopgen_q04/duckdb:vortex-compact 3519361483 3541305368 0.99
statpopgen_q05/duckdb:vortex-compact 1808875483 1831969834 0.99
statpopgen_q06/duckdb:vortex-compact 2658109065 2659423800 1.00
statpopgen_q07/duckdb:vortex-compact 961106500 951551000 1.01
statpopgen_q08/duckdb:vortex-compact 1010775860 993210828 1.02
statpopgen_q09/duckdb:vortex-compact 3387348578 3334621535 1.02
statpopgen_q10/duckdb:vortex-compact 5378039100 5346003959 1.01
duckdb / parquet (0.994x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 309341700 314251559 0.98
statpopgen_q01/duckdb:parquet 398440951 398809324 1.00
statpopgen_q02/duckdb:parquet 1000013326 991202016 1.01
statpopgen_q03/duckdb:parquet 1484619516 1476276228 1.01
statpopgen_q04/duckdb:parquet 1484803125 1517910377 0.98
statpopgen_q05/duckdb:parquet 984505720 989599455 0.99
statpopgen_q06/duckdb:parquet 1473362639 1477288557 1.00
statpopgen_q07/duckdb:parquet 1864852814 1868588753 1.00
statpopgen_q08/duckdb:parquet 1872440354 1872597277 1.00
statpopgen_q09/duckdb:parquet 1350957318 1397727369 0.97
statpopgen_q10/duckdb:parquet 2660255307 2649639425 1.00
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +2.3% -1.6% +3.9% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +0.4% -1.6% +2.0% +11.3% ➖ noise
1 duckdb:vortex-compact -0.2% -0.1% -0.1% +10.0% ➖ noise
1 duckdb:vortex-file-compressed +46.8% -0.1% +46.9% +264.6% ➖ noise
2 duckdb:vortex-compact +0.2% +0.9% -0.7% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.9% +0.9% -0.0% +10.0% ➖ noise
3 duckdb:vortex-compact -1.3% +0.6% -1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -0.8% +0.6% -1.4% +10.0% ➖ noise
4 duckdb:vortex-compact -0.6% -2.2% +1.6% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +0.3% -2.2% +2.5% +10.0% ➖ noise
5 duckdb:vortex-compact -1.3% -0.5% -0.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.1% -0.5% -0.6% +10.0% ➖ noise
6 duckdb:vortex-compact -0.0% -0.3% +0.2% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% -0.3% +0.2% +10.0% ➖ noise
7 duckdb:vortex-compact +1.0% -0.2% +1.2% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -4.2% -0.2% -4.0% +10.0% ➖ noise
8 duckdb:vortex-compact +1.8% -0.0% +1.8% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.0% -0.0% +0.0% +10.0% ➖ noise
9 duckdb:vortex-compact +1.6% -3.3% +5.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +0.7% -3.3% +4.2% +10.0% ➖ noise
10 duckdb:vortex-compact +0.6% +0.4% +0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.4% +0.4% -1.8% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Vortex (geomean): 1.009x ➖
Parquet (geomean): 1.000x ➖
Shifts: Parquet (control) -0.0% · Median polish +0.1%

datafusion / vortex-file-compressed (1.007x ➖, 1↑ 3↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 1874722 1928793 0.97
clickbench_q01/datafusion:vortex-file-compressed 14137158 15376482 0.92
clickbench_q02/datafusion:vortex-file-compressed 33817745 32376788 1.04
clickbench_q03/datafusion:vortex-file-compressed 37232274 37246233 1.00
clickbench_q04/datafusion:vortex-file-compressed 300670686 310060725 0.97
clickbench_q05/datafusion:vortex-file-compressed 315828988 328309862 0.96
clickbench_q06/datafusion:vortex-file-compressed 🚨 2594924 1873633 1.38
clickbench_q07/datafusion:vortex-file-compressed 18433389 18613237 0.99
clickbench_q08/datafusion:vortex-file-compressed 384234555 376206121 1.02
clickbench_q09/datafusion:vortex-file-compressed 553529879 550820778 1.00
clickbench_q10/datafusion:vortex-file-compressed 72387528 73149556 0.99
clickbench_q11/datafusion:vortex-file-compressed 83825005 81914658 1.02
clickbench_q12/datafusion:vortex-file-compressed 279501044 266720779 1.05
clickbench_q13/datafusion:vortex-file-compressed 414180449 421239926 0.98
clickbench_q14/datafusion:vortex-file-compressed 255283213 252478508 1.01
clickbench_q15/datafusion:vortex-file-compressed 362571885 362971034 1.00
clickbench_q16/datafusion:vortex-file-compressed 691929172 687311370 1.01
clickbench_q17/datafusion:vortex-file-compressed 692984546 683734008 1.01
clickbench_q18/datafusion:vortex-file-compressed 1364257709 1369507039 1.00
clickbench_q19/datafusion:vortex-file-compressed 23695762 22754756 1.04
clickbench_q20/datafusion:vortex-file-compressed 361381426 356359188 1.01
clickbench_q21/datafusion:vortex-file-compressed 420439202 419059553 1.00
clickbench_q22/datafusion:vortex-file-compressed 547019794 552678016 0.99
clickbench_q23/datafusion:vortex-file-compressed 🚀 650865914 745541302 0.87
clickbench_q24/datafusion:vortex-file-compressed 🚨 55308413 48093496 1.15
clickbench_q25/datafusion:vortex-file-compressed 🚨 77450186 67416252 1.15
clickbench_q26/datafusion:vortex-file-compressed 42872022 44685342 0.96
clickbench_q27/datafusion:vortex-file-compressed 784668560 787828662 1.00
clickbench_q28/datafusion:vortex-file-compressed 6737421462 6783742618 0.99
clickbench_q29/datafusion:vortex-file-compressed 243196583 241864713 1.01
clickbench_q30/datafusion:vortex-file-compressed 221917329 222585356 1.00
clickbench_q31/datafusion:vortex-file-compressed 267067484 266446442 1.00
clickbench_q32/datafusion:vortex-file-compressed 1222553848 1210941359 1.01
clickbench_q33/datafusion:vortex-file-compressed 1385063489 1460274141 0.95
clickbench_q34/datafusion:vortex-file-compressed 1447162162 1445954112 1.00
clickbench_q35/datafusion:vortex-file-compressed 509657287 508990591 1.00
clickbench_q36/datafusion:vortex-file-compressed 80706945 79388605 1.02
clickbench_q37/datafusion:vortex-file-compressed 39040346 39204875 1.00
clickbench_q38/datafusion:vortex-file-compressed 23898168 23431773 1.02
clickbench_q39/datafusion:vortex-file-compressed 143456758 152494794 0.94
clickbench_q40/datafusion:vortex-file-compressed 19133451 19226506 1.00
clickbench_q41/datafusion:vortex-file-compressed 17430802 18480638 0.94
clickbench_q42/datafusion:vortex-file-compressed 20669609 20427610 1.01
datafusion / parquet (0.993x ➖, 1↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1834403 1969337 0.93
clickbench_q01/datafusion:parquet 20939953 21210871 0.99
clickbench_q02/datafusion:parquet 57402960 58519513 0.98
clickbench_q03/datafusion:parquet 44878373 47156481 0.95
clickbench_q04/datafusion:parquet 347883356 382231750 0.91
clickbench_q05/datafusion:parquet 381800433 413994781 0.92
clickbench_q06/datafusion:parquet 🚀 1792830 1995520 0.90
clickbench_q07/datafusion:parquet 27402845 27197822 1.01
clickbench_q08/datafusion:parquet 432038291 478982572 0.90
clickbench_q09/datafusion:parquet 667506919 689096318 0.97
clickbench_q10/datafusion:parquet 118581687 115654859 1.03
clickbench_q11/datafusion:parquet 139972378 142579951 0.98
clickbench_q12/datafusion:parquet 357252943 372367359 0.96
clickbench_q13/datafusion:parquet 503277046 509123830 0.99
clickbench_q14/datafusion:parquet 359869961 360002198 1.00
clickbench_q15/datafusion:parquet 394146988 394184288 1.00
clickbench_q16/datafusion:parquet 716824971 711957513 1.01
clickbench_q17/datafusion:parquet 681208084 685495432 0.99
clickbench_q18/datafusion:parquet 1435729422 1453108580 0.99
clickbench_q19/datafusion:parquet 34113114 33914890 1.01
clickbench_q20/datafusion:parquet 634968927 604112070 1.05
clickbench_q21/datafusion:parquet 663906084 658264084 1.01
clickbench_q22/datafusion:parquet 972942808 961604266 1.01
clickbench_q23/datafusion:parquet 3650833364 3584788087 1.02
clickbench_q24/datafusion:parquet 94788940 89188774 1.06
clickbench_q25/datafusion:parquet 147445308 138824700 1.06
clickbench_q26/datafusion:parquet 88851812 83620180 1.06
clickbench_q27/datafusion:parquet 1049467082 1055601076 0.99
clickbench_q28/datafusion:parquet 6603074833 6574007603 1.00
clickbench_q29/datafusion:parquet 246243495 252527474 0.98
clickbench_q30/datafusion:parquet 357447384 360434815 0.99
clickbench_q31/datafusion:parquet 385785292 385321321 1.00
clickbench_q32/datafusion:parquet 1292582791 1276241892 1.01
clickbench_q33/datafusion:parquet 1620499545 1521771850 1.06
clickbench_q34/datafusion:parquet 1536033755 1508900728 1.02
clickbench_q35/datafusion:parquet 535333223 527725811 1.01
clickbench_q36/datafusion:parquet 141132626 146948585 0.96
clickbench_q37/datafusion:parquet 59877514 60560562 0.99
clickbench_q38/datafusion:parquet 88077900 87963101 1.00
clickbench_q39/datafusion:parquet 285649444 276541645 1.03
clickbench_q40/datafusion:parquet 34916181 34656733 1.01
clickbench_q41/datafusion:parquet 29864243 30295533 0.99
clickbench_q42/datafusion:parquet 32376609 32639867 0.99
duckdb / vortex-file-compressed (1.011x ➖, 2↑ 8↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 🚨 6895302 6065766 1.14
clickbench_q01/duckdb:vortex-file-compressed 13730438 13520150 1.02
clickbench_q02/duckdb:vortex-file-compressed 24290079 23918932 1.02
clickbench_q03/duckdb:vortex-file-compressed 30421329 32270989 0.94
clickbench_q04/duckdb:vortex-file-compressed 172904603 168769882 1.02
clickbench_q05/duckdb:vortex-file-compressed 194070046 197075590 0.98
clickbench_q06/duckdb:vortex-file-compressed 18782717 19077299 0.98
clickbench_q07/duckdb:vortex-file-compressed 15429790 15136533 1.02
clickbench_q08/duckdb:vortex-file-compressed 262481285 259289000 1.01
clickbench_q09/duckdb:vortex-file-compressed 372866604 375892141 0.99
clickbench_q10/duckdb:vortex-file-compressed 74327053 74408098 1.00
clickbench_q11/duckdb:vortex-file-compressed 83685387 83318450 1.00
clickbench_q12/duckdb:vortex-file-compressed 217423555 215562405 1.01
clickbench_q13/duckdb:vortex-file-compressed 433238484 445674015 0.97
clickbench_q14/duckdb:vortex-file-compressed 238521849 242691088 0.98
clickbench_q15/duckdb:vortex-file-compressed 209765600 208458893 1.01
clickbench_q16/duckdb:vortex-file-compressed 700313294 750150954 0.93
clickbench_q17/duckdb:vortex-file-compressed 532691451 576486965 0.92
clickbench_q18/duckdb:vortex-file-compressed 1259816856 1249306925 1.01
clickbench_q19/duckdb:vortex-file-compressed 21027044 20308044 1.04
clickbench_q20/duckdb:vortex-file-compressed 383702219 399434192 0.96
clickbench_q21/duckdb:vortex-file-compressed 414102721 420244586 0.99
clickbench_q22/duckdb:vortex-file-compressed 🚀 600379029 694529069 0.86
clickbench_q23/duckdb:vortex-file-compressed 🚀 1142366102 1735945198 0.66
clickbench_q24/duckdb:vortex-file-compressed 🚨 49759706 42389171 1.17
clickbench_q25/duckdb:vortex-file-compressed 75743862 76814779 0.99
clickbench_q26/duckdb:vortex-file-compressed 🚨 47569298 38932935 1.22
clickbench_q27/duckdb:vortex-file-compressed 531819847 532115101 1.00
clickbench_q28/duckdb:vortex-file-compressed 3002485239 3008104084 1.00
clickbench_q29/duckdb:vortex-file-compressed 28704495 29580120 0.97
clickbench_q30/duckdb:vortex-file-compressed 178129519 174261469 1.02
clickbench_q31/duckdb:vortex-file-compressed 261574088 253656763 1.03
clickbench_q32/duckdb:vortex-file-compressed 1442164033 1399203153 1.03
clickbench_q33/duckdb:vortex-file-compressed 1479820211 1552945603 0.95
clickbench_q34/duckdb:vortex-file-compressed 1610484570 1643469509 0.98
clickbench_q35/duckdb:vortex-file-compressed 366870768 363639964 1.01
clickbench_q36/duckdb:vortex-file-compressed 33421100 31412146 1.06
clickbench_q37/duckdb:vortex-file-compressed 🚨 25614428 23053361 1.11
clickbench_q38/duckdb:vortex-file-compressed 🚨 26889503 23929603 1.12
clickbench_q39/duckdb:vortex-file-compressed 48089877 45439367 1.06
clickbench_q40/duckdb:vortex-file-compressed 🚨 26324472 22655115 1.16
clickbench_q41/duckdb:vortex-file-compressed 🚨 24434994 21757017 1.12
clickbench_q42/duckdb:vortex-file-compressed 🚨 28169102 24202653 1.16
duckdb / parquet (1.007x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 🚨 244117944 220831422 1.11
clickbench_q01/duckdb:parquet 50404618 50598975 1.00
clickbench_q02/duckdb:parquet 66587266 65544863 1.02
clickbench_q03/duckdb:parquet 64616219 63927553 1.01
clickbench_q04/duckdb:parquet 202620332 202971652 1.00
clickbench_q05/duckdb:parquet 280018989 285357950 0.98
clickbench_q06/duckdb:parquet 60736868 59273954 1.02
clickbench_q07/duckdb:parquet 52332329 50841020 1.03
clickbench_q08/duckdb:parquet 269853571 272640804 0.99
clickbench_q09/duckdb:parquet 397339673 394925373 1.01
clickbench_q10/duckdb:parquet 96300169 94662047 1.02
clickbench_q11/duckdb:parquet 107193212 108715167 0.99
clickbench_q12/duckdb:parquet 296681111 298387333 0.99
clickbench_q13/duckdb:parquet 513081290 515158300 1.00
clickbench_q14/duckdb:parquet 331617607 332225813 1.00
clickbench_q15/duckdb:parquet 240544393 240852056 1.00
clickbench_q16/duckdb:parquet 616035426 612050524 1.01
clickbench_q17/duckdb:parquet 507289593 508091888 1.00
clickbench_q18/duckdb:parquet 1057015918 1062529130 0.99
clickbench_q19/duckdb:parquet 48807253 48701541 1.00
clickbench_q20/duckdb:parquet 432855746 435840147 0.99
clickbench_q21/duckdb:parquet 563959289 558780281 1.01
clickbench_q22/duckdb:parquet 939290762 934362005 1.01
clickbench_q23/duckdb:parquet 324917785 317897364 1.02
clickbench_q24/duckdb:parquet 78808989 78019731 1.01
clickbench_q25/duckdb:parquet 143327677 141033631 1.02
clickbench_q26/duckdb:parquet 53816152 55038830 0.98
clickbench_q27/duckdb:parquet 639138845 646291593 0.99
clickbench_q28/duckdb:parquet 4863913732 4852834870 1.00
clickbench_q29/duckdb:parquet 61877388 60718105 1.02
clickbench_q30/duckdb:parquet 305764294 303867247 1.01
clickbench_q31/duckdb:parquet 350387978 353409245 0.99
clickbench_q32/duckdb:parquet 1142831224 1118392772 1.02
clickbench_q33/duckdb:parquet 1276638071 1226480463 1.04
clickbench_q34/duckdb:parquet 1260319972 1234108951 1.02
clickbench_q35/duckdb:parquet 354838338 352083669 1.01
clickbench_q36/duckdb:parquet 65344235 63601239 1.03
clickbench_q37/duckdb:parquet 53455223 53915772 0.99
clickbench_q38/duckdb:parquet 58533311 58020708 1.01
clickbench_q39/duckdb:parquet 97301940 100050869 0.97
clickbench_q40/duckdb:parquet 56029829 55830375 1.00
clickbench_q41/duckdb:parquet 59565331 59400454 1.00
clickbench_q42/duckdb:parquet 49495319 49540127 1.00
duckdb / duckdb (1.011x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17547002 17747314 0.99
clickbench_q01/duckdb:duckdb 33147657 32569363 1.02
clickbench_q02/duckdb:duckdb 45015327 44840679 1.00
clickbench_q03/duckdb:duckdb 47264048 47476257 1.00
clickbench_q04/duckdb:duckdb 222891700 213256005 1.05
clickbench_q05/duckdb:duckdb 327473579 326774300 1.00
clickbench_q06/duckdb:duckdb 34921367 34945213 1.00
clickbench_q07/duckdb:duckdb 35207278 35094727 1.00
clickbench_q08/duckdb:duckdb 314452485 313485503 1.00
clickbench_q09/duckdb:duckdb 482703428 482131401 1.00
clickbench_q10/duckdb:duckdb 96851666 98645475 0.98
clickbench_q11/duckdb:duckdb 107266014 107172602 1.00
clickbench_q12/duckdb:duckdb 304940779 294626219 1.04
clickbench_q13/duckdb:duckdb 553503147 547481285 1.01
clickbench_q14/duckdb:duckdb 344205584 327991014 1.05
clickbench_q15/duckdb:duckdb 272349959 256341338 1.06
clickbench_q16/duckdb:duckdb 695958861 696376502 1.00
clickbench_q17/duckdb:duckdb 606678934 571373923 1.06
clickbench_q18/duckdb:duckdb 1290165725 1273360302 1.01
clickbench_q19/duckdb:duckdb 34635764 34518468 1.00
clickbench_q20/duckdb:duckdb 1021147146 985029826 1.04
clickbench_q21/duckdb:duckdb 1063622050 1081138423 0.98
clickbench_q22/duckdb:duckdb 1156871827 1168805070 0.99
clickbench_q23/duckdb:duckdb 258348875 251650094 1.03
clickbench_q24/duckdb:duckdb 60513104 60848390 0.99
clickbench_q25/duckdb:duckdb 122912279 124218166 0.99
clickbench_q26/duckdb:duckdb 52727275 54444547 0.97
clickbench_q27/duckdb:duckdb 1064957199 1129558873 0.94
clickbench_q28/duckdb:duckdb 4644451099 4659245096 1.00
clickbench_q29/duckdb:duckdb 48034231 48404468 0.99
clickbench_q30/duckdb:duckdb 289932765 288307633 1.01
clickbench_q31/duckdb:duckdb 425482162 397535753 1.07
clickbench_q32/duckdb:duckdb 1499467180 1477314162 1.01
clickbench_q33/duckdb:duckdb 1946756698 2006885425 0.97
clickbench_q34/duckdb:duckdb 2134857939 1989093655 1.07
clickbench_q35/duckdb:duckdb 264646729 265292857 1.00
clickbench_q36/duckdb:duckdb 🚨 41463519 36875156 1.12
clickbench_q37/duckdb:duckdb 30984710 31125821 1.00
clickbench_q38/duckdb:duckdb 30292975 30295902 1.00
clickbench_q39/duckdb:duckdb 65921791 62534846 1.05
clickbench_q40/duckdb:duckdb 31306876 31666943 0.99
clickbench_q41/duckdb:duckdb 31005513 30241290 1.03
clickbench_q42/duckdb:duckdb 30936257 31186652 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed -2.8% +1.5% -4.2% +547.0% ➖ noise
0 duckdb:duckdb -1.1% +1.5% -2.6% +262.4% ➖ noise
0 duckdb:vortex-file-compressed +13.7% +1.5% +12.0% +304.0% ➖ noise
1 datafusion:vortex-file-compressed -8.1% -0.8% -7.3% +36.8% ➖ noise
1 duckdb:duckdb +1.8% -0.8% +2.6% +56.6% ➖ noise
1 duckdb:vortex-file-compressed +1.6% -0.8% +2.4% +19.8% ➖ noise
2 datafusion:vortex-file-compressed +4.5% -0.2% +4.6% +34.6% ➖ noise
2 duckdb:duckdb +0.4% -0.2% +0.6% +23.1% ➖ noise
2 duckdb:vortex-file-compressed +1.6% -0.2% +1.7% +11.1% ➖ noise
3 datafusion:vortex-file-compressed -0.0% -1.9% +1.9% +165.7% ➖ noise
3 duckdb:duckdb -0.4% -1.9% +1.5% +51.6% ➖ noise
3 duckdb:vortex-file-compressed -5.7% -1.9% -3.9% +27.7% ➖ noise
4 datafusion:vortex-file-compressed -3.0% -4.7% +1.7% +10.0% ➖ noise
4 duckdb:duckdb +4.5% -4.7% +9.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.4% -4.7% +7.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -3.8% -4.9% +1.1% +10.0% ➖ noise
5 duckdb:duckdb +0.2% -4.9% +5.3% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -1.5% -4.9% +3.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +38.5% -4.1% +44.3% +36.4% 🚨 regression
6 duckdb:duckdb -0.1% -4.1% +4.2% +29.9% ➖ noise
6 duckdb:vortex-file-compressed -1.5% -4.1% +2.6% +19.6% ➖ noise
7 datafusion:vortex-file-compressed -1.0% +1.8% -2.8% +11.5% ➖ noise
7 duckdb:duckdb +0.3% +1.8% -1.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.9% +1.8% +0.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +2.1% -5.5% +8.1% +10.0% ➖ noise
8 duckdb:duckdb +0.3% -5.5% +6.2% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +1.2% -5.5% +7.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +0.5% -1.3% +1.8% +10.0% ➖ noise
9 duckdb:duckdb +0.1% -1.3% +1.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.8% -1.3% +0.5% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -1.0% +2.1% -3.1% +10.0% ➖ noise
10 duckdb:duckdb -1.8% +2.1% -3.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -0.1% +2.1% -2.2% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +2.3% -1.6% +4.0% +10.0% ➖ noise
11 duckdb:duckdb +0.1% -1.6% +1.7% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +0.4% -1.6% +2.1% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +4.8% -2.3% +7.3% +10.0% ➖ noise
12 duckdb:duckdb +3.5% -2.3% +6.0% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +0.9% -2.3% +3.3% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.7% -0.8% -0.9% +10.0% ➖ noise
13 duckdb:duckdb +1.1% -0.8% +1.9% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -2.8% -0.8% -2.0% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.1% -0.1% +1.2% +10.0% ➖ noise
14 duckdb:duckdb +4.9% -0.1% +5.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -1.7% -0.1% -1.6% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.1% -0.1% -0.0% +10.0% ➖ noise
15 duckdb:duckdb +6.2% -0.1% +6.3% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +0.6% -0.1% +0.7% +10.0% ➖ noise
16 datafusion:vortex-file-compressed +0.7% +0.7% +0.0% +10.0% ➖ noise
16 duckdb:duckdb -0.1% +0.7% -0.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -6.6% +0.7% -7.3% +14.7% ➖ noise
17 datafusion:vortex-file-compressed +1.4% -0.4% +1.8% +10.0% ➖ noise
17 duckdb:duckdb +6.2% -0.4% +6.6% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -7.6% -0.4% -7.2% +14.7% ➖ noise
18 datafusion:vortex-file-compressed -0.4% -0.9% +0.5% +10.0% ➖ noise
18 duckdb:duckdb +1.3% -0.9% +2.2% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +0.8% -0.9% +1.7% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +4.1% +0.4% +3.7% +11.9% ➖ noise
19 duckdb:duckdb +0.3% +0.4% -0.1% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +3.5% +0.4% +3.1% +31.2% ➖ noise
20 datafusion:vortex-file-compressed +1.4% +2.2% -0.7% +168.7% ➖ noise
20 duckdb:duckdb +3.7% +2.2% +1.5% +22.0% ➖ noise
20 duckdb:vortex-file-compressed -3.9% +2.2% -6.0% +12.2% ➖ noise
21 datafusion:vortex-file-compressed +0.3% +0.9% -0.6% +10.0% ➖ noise
21 duckdb:duckdb -1.6% +0.9% -2.5% +15.8% ➖ noise
21 duckdb:vortex-file-compressed -1.5% +0.9% -2.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -1.0% +0.9% -1.9% +10.6% ➖ noise
22 duckdb:duckdb -1.0% +0.9% -1.9% +10.1% ➖ noise
22 duckdb:vortex-file-compressed -13.6% +0.9% -14.3% +18.6% ➖ noise
23 datafusion:vortex-file-compressed -12.7% +2.0% -14.4% +49.3% ➖ noise
23 duckdb:duckdb +2.7% +2.0% +0.6% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -34.2% +2.0% -35.5% +10.0% ✅ faster
24 datafusion:vortex-file-compressed +15.0% +3.6% +11.0% +17.8% ➖ noise
24 duckdb:duckdb -0.6% +3.6% -4.0% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +17.4% +3.6% +13.3% +27.7% ➖ noise
25 datafusion:vortex-file-compressed +14.9% +3.9% +10.6% +20.0% ➖ noise
25 duckdb:duckdb -1.1% +3.9% -4.8% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -1.4% +3.9% -5.1% +14.8% ➖ noise
26 datafusion:vortex-file-compressed -4.1% +1.9% -5.9% +10.0% ➖ noise
26 duckdb:duckdb -3.2% +1.9% -5.0% +13.1% ➖ noise
26 duckdb:vortex-file-compressed +22.2% +1.9% +19.9% +29.1% ➖ noise
27 datafusion:vortex-file-compressed -0.4% -0.8% +0.4% +10.0% ➖ noise
27 duckdb:duckdb -5.7% -0.8% -4.9% +10.4% ➖ noise
27 duckdb:vortex-file-compressed -0.1% -0.8% +0.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.7% +0.3% -1.0% +10.0% ➖ noise
28 duckdb:duckdb -0.3% +0.3% -0.7% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.2% +0.3% -0.5% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.6% -0.3% +0.9% +11.6% ➖ noise
29 duckdb:duckdb -0.8% -0.3% -0.5% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -3.0% -0.3% -2.7% +10.2% ➖ noise
30 datafusion:vortex-file-compressed -0.3% -0.1% -0.2% +10.0% ➖ noise
30 duckdb:duckdb +0.6% -0.1% +0.7% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +2.2% -0.1% +2.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +0.2% -0.4% +0.6% +10.0% ➖ noise
31 duckdb:duckdb +7.0% -0.4% +7.4% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +3.1% -0.4% +3.5% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.0% +1.7% -0.8% +19.2% ➖ noise
32 duckdb:duckdb +1.5% +1.7% -0.2% +10.0% ➖ noise
32 duckdb:vortex-file-compressed +3.1% +1.7% +1.3% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -5.2% +5.3% -9.9% +10.4% ✅ faster
33 duckdb:duckdb -3.0% +5.3% -7.9% +14.5% ➖ noise
33 duckdb:vortex-file-compressed -4.7% +5.3% -9.5% +10.0% ✅ faster
34 datafusion:vortex-file-compressed +0.1% +2.0% -1.8% +10.0% ➖ noise
34 duckdb:duckdb +7.3% +2.0% +5.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -2.0% +2.0% -3.9% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +0.1% +1.1% -1.0% +10.0% ➖ noise
35 duckdb:duckdb -0.2% +1.1% -1.3% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +0.9% +1.1% -0.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +1.7% -0.7% +2.3% +10.0% ➖ noise
36 duckdb:duckdb +12.4% -0.7% +13.2% +10.0% 🚨 regression
36 duckdb:vortex-file-compressed +6.4% -0.7% +7.1% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -0.4% -1.0% +0.6% +10.0% ➖ noise
37 duckdb:duckdb -0.5% -1.0% +0.5% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +11.1% -1.0% +12.2% +10.0% 🚨 regression
38 datafusion:vortex-file-compressed +2.0% +0.5% +1.5% +10.0% ➖ noise
38 duckdb:duckdb -0.0% +0.5% -0.5% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +12.4% +0.5% +11.8% +10.0% 🚨 regression
39 datafusion:vortex-file-compressed -5.9% +0.2% -6.1% +10.0% ➖ noise
39 duckdb:duckdb +5.4% +0.2% +5.2% +13.8% ➖ noise
39 duckdb:vortex-file-compressed +5.8% +0.2% +5.6% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -0.5% +0.6% -1.0% +10.0% ➖ noise
40 duckdb:duckdb -1.1% +0.6% -1.7% +10.0% ➖ noise
40 duckdb:vortex-file-compressed +16.2% +0.6% +15.6% +10.0% 🚨 regression
41 datafusion:vortex-file-compressed -5.7% -0.6% -5.1% +10.0% ➖ noise
41 duckdb:duckdb +2.5% -0.6% +3.1% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +12.3% -0.6% +13.0% +18.0% ➖ noise
42 datafusion:vortex-file-compressed +1.2% -0.4% +1.6% +10.0% ➖ noise
42 duckdb:duckdb -0.8% -0.4% -0.4% +10.0% ➖ noise
42 duckdb:vortex-file-compressed +16.4% -0.4% +16.9% +10.0% 🚨 regression

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +14.2%
Vortex (geomean): 1.049x ➖
Parquet (geomean): 0.919x ➖
Shifts: Parquet (control) -8.1% · Median polish +1.9%

datafusion / vortex-file-compressed (1.053x ➖, 4↑ 5↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚨 428925715 185659825 2.31
tpch_q02/datafusion:vortex-file-compressed 615404585 506460503 1.22
tpch_q03/datafusion:vortex-file-compressed 411406894 355802978 1.16
tpch_q04/datafusion:vortex-file-compressed 233757139 296753595 0.79
tpch_q05/datafusion:vortex-file-compressed 574043084 503845414 1.14
tpch_q06/datafusion:vortex-file-compressed 457489776 352963238 1.30
tpch_q07/datafusion:vortex-file-compressed 🚨 619376610 403628575 1.53
tpch_q08/datafusion:vortex-file-compressed 🚨 1017110125 660409530 1.54
tpch_q09/datafusion:vortex-file-compressed 🚨 683111448 448778937 1.52
tpch_q10/datafusion:vortex-file-compressed 788306479 635392747 1.24
tpch_q11/datafusion:vortex-file-compressed 396533236 424845235 0.93
tpch_q12/datafusion:vortex-file-compressed 607447483 530611951 1.14
tpch_q13/datafusion:vortex-file-compressed 🚨 365711481 220479013 1.66
tpch_q14/datafusion:vortex-file-compressed 316916584 252149558 1.26
tpch_q15/datafusion:vortex-file-compressed 496522949 467244378 1.06
tpch_q16/datafusion:vortex-file-compressed 189290743 223184787 0.85
tpch_q17/datafusion:vortex-file-compressed 415213479 558199939 0.74
tpch_q18/datafusion:vortex-file-compressed 🚀 354663936 587680474 0.60
tpch_q19/datafusion:vortex-file-compressed 🚀 433542905 800793712 0.54
tpch_q20/datafusion:vortex-file-compressed 🚀 397906320 650643435 0.61
tpch_q21/datafusion:vortex-file-compressed 🚀 584315173 894008754 0.65
tpch_q22/datafusion:vortex-file-compressed 285591897 300045988 0.95
datafusion / vortex-compact (1.191x ➖, 0↑ 7↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 442009364 349349583 1.27
tpch_q02/datafusion:vortex-compact 604622396 637968631 0.95
tpch_q03/datafusion:vortex-compact 382101809 369723964 1.03
tpch_q04/datafusion:vortex-compact 🚨 356969611 256263954 1.39
tpch_q05/datafusion:vortex-compact 🚨 595720961 345835597 1.72
tpch_q06/datafusion:vortex-compact 🚨 422759212 306446010 1.38
tpch_q07/datafusion:vortex-compact 524425212 430230548 1.22
tpch_q08/datafusion:vortex-compact 634633689 536113474 1.18
tpch_q09/datafusion:vortex-compact 438580201 419298420 1.05
tpch_q10/datafusion:vortex-compact 487128394 466938254 1.04
tpch_q11/datafusion:vortex-compact 249313569 248821427 1.00
tpch_q12/datafusion:vortex-compact 720317662 562573059 1.28
tpch_q13/datafusion:vortex-compact 278229037 228642329 1.22
tpch_q14/datafusion:vortex-compact 🚨 390599054 287900905 1.36
tpch_q15/datafusion:vortex-compact 🚨 666582383 464336471 1.44
tpch_q16/datafusion:vortex-compact 161803998 169417827 0.96
tpch_q17/datafusion:vortex-compact 🚨 477416128 354304038 1.35
tpch_q18/datafusion:vortex-compact 360552741 307995724 1.17
tpch_q19/datafusion:vortex-compact 🚨 601328398 428231615 1.40
tpch_q20/datafusion:vortex-compact 514116908 464774900 1.11
tpch_q21/datafusion:vortex-compact 632855000 494604253 1.28
tpch_q22/datafusion:vortex-compact 155552085 196338914 0.79
datafusion / parquet (0.851x ➖, 6↑ 2↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚀 259410096 486339357 0.53
tpch_q02/datafusion:parquet 464394667 501682884 0.93
tpch_q03/datafusion:parquet 🚀 496235370 975981611 0.51
tpch_q04/datafusion:parquet 184482426 201482903 0.92
tpch_q05/datafusion:parquet 627795683 748610614 0.84
tpch_q06/datafusion:parquet 🚀 193433698 460580384 0.42
tpch_q07/datafusion:parquet 🚀 618472465 1079061969 0.57
tpch_q08/datafusion:parquet 621545299 847897550 0.73
tpch_q09/datafusion:parquet 584038026 624454372 0.94
tpch_q10/datafusion:parquet 🚀 490093847 701848008 0.70
tpch_q11/datafusion:parquet 🚀 328175731 484580071 0.68
tpch_q12/datafusion:parquet 297241027 305462555 0.97
tpch_q13/datafusion:parquet 522542811 468333443 1.12
tpch_q14/datafusion:parquet 🚨 231189299 170198752 1.36
tpch_q15/datafusion:parquet 358897116 317481776 1.13
tpch_q16/datafusion:parquet 187769025 179922148 1.04
tpch_q17/datafusion:parquet 370915527 379344154 0.98
tpch_q18/datafusion:parquet 454385147 454768284 1.00
tpch_q19/datafusion:parquet 329385322 370374870 0.89
tpch_q20/datafusion:parquet 331364409 420930760 0.79
tpch_q21/datafusion:parquet 818755024 750926121 1.09
tpch_q22/datafusion:parquet 🚨 285798120 193348787 1.48
duckdb / vortex-file-compressed (1.005x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 292578593 279645161 1.05
tpch_q02/duckdb:vortex-file-compressed 1064225760 990522897 1.07
tpch_q03/duckdb:vortex-file-compressed 610893671 706970865 0.86
tpch_q04/duckdb:vortex-file-compressed 367588948 511285448 0.72
tpch_q05/duckdb:vortex-file-compressed 936987468 986741598 0.95
tpch_q06/duckdb:vortex-file-compressed 528699556 566480568 0.93
tpch_q07/duckdb:vortex-file-compressed 761876141 829597833 0.92
tpch_q08/duckdb:vortex-file-compressed 971467896 957632066 1.01
tpch_q09/duckdb:vortex-file-compressed 950419976 920529607 1.03
tpch_q10/duckdb:vortex-file-compressed 745148073 799711364 0.93
tpch_q11/duckdb:vortex-file-compressed 588810291 501532315 1.17
tpch_q12/duckdb:vortex-file-compressed 580836749 568775063 1.02
tpch_q13/duckdb:vortex-file-compressed 466125443 458064765 1.02
tpch_q14/duckdb:vortex-file-compressed 451256328 519179882 0.87
tpch_q15/duckdb:vortex-file-compressed 🚨 345464861 260714314 1.33
tpch_q16/duckdb:vortex-file-compressed 397920225 350688890 1.13
tpch_q17/duckdb:vortex-file-compressed 740048404 689539985 1.07
tpch_q18/duckdb:vortex-file-compressed 636446793 722548026 0.88
tpch_q19/duckdb:vortex-file-compressed 568328470 488261973 1.16
tpch_q20/duckdb:vortex-file-compressed 820930810 878803372 0.93
tpch_q21/duckdb:vortex-file-compressed 1217141165 1030647851 1.18
tpch_q22/duckdb:vortex-file-compressed 396789334 382669244 1.04
duckdb / vortex-compact (0.960x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 308455091 412324708 0.75
tpch_q02/duckdb:vortex-compact 897524833 1049213032 0.86
tpch_q03/duckdb:vortex-compact 530204739 571551777 0.93
tpch_q04/duckdb:vortex-compact 363361195 325844922 1.12
tpch_q05/duckdb:vortex-compact 818666720 835983275 0.98
tpch_q06/duckdb:vortex-compact 420299273 471504328 0.89
tpch_q07/duckdb:vortex-compact 815284249 740161372 1.10
tpch_q08/duckdb:vortex-compact 933102223 990106059 0.94
tpch_q09/duckdb:vortex-compact 910371168 1023570840 0.89
tpch_q10/duckdb:vortex-compact 684612631 695279838 0.98
tpch_q11/duckdb:vortex-compact 491473820 542216458 0.91
tpch_q12/duckdb:vortex-compact 436124803 594612081 0.73
tpch_q13/duckdb:vortex-compact 462871837 445672070 1.04
tpch_q14/duckdb:vortex-compact 525603238 483361692 1.09
tpch_q15/duckdb:vortex-compact 379849727 326741608 1.16
tpch_q16/duckdb:vortex-compact 343325688 366444845 0.94
tpch_q17/duckdb:vortex-compact 662294037 589589144 1.12
tpch_q18/duckdb:vortex-compact 460461193 472253009 0.98
tpch_q19/duckdb:vortex-compact 505181165 464154456 1.09
tpch_q20/duckdb:vortex-compact 772501891 960752199 0.80
tpch_q21/duckdb:vortex-compact 1135703876 1225298162 0.93
tpch_q22/duckdb:vortex-compact 354243951 332868561 1.06
duckdb / parquet (0.991x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 744842963 597001846 1.25
tpch_q02/duckdb:parquet 1405975671 1322150109 1.06
tpch_q03/duckdb:parquet 1186217003 998770374 1.19
tpch_q04/duckdb:parquet 763904190 819854797 0.93
tpch_q05/duckdb:parquet 1825562303 1578968921 1.16
tpch_q06/duckdb:parquet 483080714 392570135 1.23
tpch_q07/duckdb:parquet 1326720361 1437420615 0.92
tpch_q08/duckdb:parquet 1718288614 1853821873 0.93
tpch_q09/duckdb:parquet 1489948401 1483049307 1.00
tpch_q10/duckdb:parquet 1474917593 1616763127 0.91
tpch_q11/duckdb:parquet 872829947 907146155 0.96
tpch_q12/duckdb:parquet 633525223 593663838 1.07
tpch_q13/duckdb:parquet 967360573 964070317 1.00
tpch_q14/duckdb:parquet 712814030 1001581269 0.71
tpch_q15/duckdb:parquet 585357612 653327885 0.90
tpch_q16/duckdb:parquet 584786813 590177883 0.99
tpch_q17/duckdb:parquet 795764996 963610735 0.83
tpch_q18/duckdb:parquet 884565754 1087685622 0.81
tpch_q19/duckdb:parquet 1059761161 1064962431 1.00
tpch_q20/duckdb:parquet 1208178599 1157914020 1.04
tpch_q21/duckdb:parquet 1263035151 1219856319 1.04
tpch_q22/duckdb:parquet 635600606 591757116 1.07
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +26.5% -18.4% +55.1% +133.6% ➖ noise
1 datafusion:vortex-file-compressed +131.0% -18.4% +183.2% +144.0% 🚨 regression
1 duckdb:vortex-compact -25.2% -18.4% -8.3% +70.3% ➖ noise
1 duckdb:vortex-file-compressed +4.6% -18.4% +28.3% +54.6% ➖ noise
2 datafusion:vortex-compact -5.2% -0.8% -4.5% +42.4% ➖ noise
2 datafusion:vortex-file-compressed +21.5% -0.8% +22.5% +42.8% ➖ noise
2 duckdb:vortex-compact -14.5% -0.8% -13.8% +42.4% ➖ noise
2 duckdb:vortex-file-compressed +7.4% -0.8% +8.3% +42.4% ➖ noise
3 datafusion:vortex-compact +3.3% -22.3% +33.0% +67.2% ➖ noise
3 datafusion:vortex-file-compressed +15.6% -22.3% +48.8% +88.4% ➖ noise
3 duckdb:vortex-compact -7.2% -22.3% +19.4% +42.4% ➖ noise
3 duckdb:vortex-file-compressed -13.6% -22.3% +11.2% +42.4% ➖ noise
4 datafusion:vortex-compact +39.3% -7.6% +50.8% +79.3% ➖ noise
4 datafusion:vortex-file-compressed -21.2% -7.6% -14.7% +49.7% ➖ noise
4 duckdb:vortex-compact +11.5% -7.6% +20.7% +67.2% ➖ noise
4 duckdb:vortex-file-compressed -28.1% -7.6% -22.2% +53.6% ➖ noise
5 datafusion:vortex-compact +72.3% -1.5% +74.9% +49.7% 🚨 regression
5 datafusion:vortex-file-compressed +13.9% -1.5% +15.7% +51.3% ➖ noise
5 duckdb:vortex-compact -2.1% -1.5% -0.5% +42.5% ➖ noise
5 duckdb:vortex-file-compressed -5.0% -1.5% -3.6% +42.6% ➖ noise
6 datafusion:vortex-compact +38.0% -28.1% +91.9% +42.4% 🚨 regression
6 datafusion:vortex-file-compressed +29.6% -28.1% +80.3% +85.1% ➖ noise
6 duckdb:vortex-compact -10.9% -28.1% +24.0% +53.4% ➖ noise
6 duckdb:vortex-file-compressed -6.7% -28.1% +29.8% +42.4% ➖ noise
7 datafusion:vortex-compact +21.9% -27.3% +67.6% +47.1% 🚨 regression
7 datafusion:vortex-file-compressed +53.5% -27.3% +111.0% +42.4% 🚨 regression
7 duckdb:vortex-compact +10.1% -27.3% +51.4% +44.1% 🚨 regression
7 duckdb:vortex-file-compressed -8.2% -27.3% +26.3% +42.4% ➖ noise
8 datafusion:vortex-compact +18.4% -17.6% +43.6% +42.4% 🚨 regression
8 datafusion:vortex-file-compressed +54.0% -17.6% +86.8% +42.4% 🚨 regression
8 duckdb:vortex-compact -5.8% -17.6% +14.3% +42.4% ➖ noise
8 duckdb:vortex-file-compressed +1.4% -17.6% +23.1% +42.4% ➖ noise
9 datafusion:vortex-compact +4.6% -3.1% +7.9% +42.4% ➖ noise
9 datafusion:vortex-file-compressed +52.2% -3.1% +57.0% +62.5% ➖ noise
9 duckdb:vortex-compact -11.1% -3.1% -8.2% +42.4% ➖ noise
9 duckdb:vortex-file-compressed +3.2% -3.1% +6.5% +42.4% ➖ noise
10 datafusion:vortex-compact +4.3% -20.2% +30.7% +42.4% ➖ noise
10 datafusion:vortex-file-compressed +24.1% -20.2% +55.4% +42.4% 🚨 regression
10 duckdb:vortex-compact -1.5% -20.2% +23.4% +42.4% ➖ noise
10 duckdb:vortex-file-compressed -6.8% -20.2% +16.7% +42.4% ➖ noise
11 datafusion:vortex-compact +0.2% -19.3% +24.1% +42.4% ➖ noise
11 datafusion:vortex-file-compressed -6.7% -19.3% +15.6% +42.4% ➖ noise
11 duckdb:vortex-compact -9.4% -19.3% +12.3% +42.4% ➖ noise
11 duckdb:vortex-file-compressed +17.4% -19.3% +45.4% +42.4% 🚨 regression
12 datafusion:vortex-compact +28.0% +1.9% +25.6% +43.3% ➖ noise
12 datafusion:vortex-file-compressed +14.5% +1.9% +12.3% +42.4% ➖ noise
12 duckdb:vortex-compact -26.7% +1.9% -28.0% +42.4% ➖ noise
12 duckdb:vortex-file-compressed +2.1% +1.9% +0.2% +42.4% ➖ noise
13 datafusion:vortex-compact +21.7% +5.8% +15.0% +98.2% ➖ noise
13 datafusion:vortex-file-compressed +65.9% +5.8% +56.8% +100.8% ➖ noise
13 duckdb:vortex-compact +3.9% +5.8% -1.8% +42.4% ➖ noise
13 duckdb:vortex-file-compressed +1.8% +5.8% -3.8% +42.4% ➖ noise
14 datafusion:vortex-compact +35.7% -1.7% +38.0% +52.9% ➖ noise
14 datafusion:vortex-file-compressed +25.7% -1.7% +27.8% +48.9% ➖ noise
14 duckdb:vortex-compact +8.7% -1.7% +10.6% +42.4% ➖ noise
14 duckdb:vortex-file-compressed -13.1% -1.7% -11.6% +42.4% ➖ noise
15 datafusion:vortex-compact +43.6% +0.6% +42.6% +42.4% 🚨 regression
15 datafusion:vortex-file-compressed +6.3% +0.6% +5.6% +42.6% ➖ noise
15 duckdb:vortex-compact +16.3% +0.6% +15.5% +42.4% ➖ noise
15 duckdb:vortex-file-compressed +32.5% +0.6% +31.7% +42.4% ➖ noise
16 datafusion:vortex-compact -4.5% +1.7% -6.1% +42.4% ➖ noise
16 datafusion:vortex-file-compressed -15.2% +1.7% -16.6% +42.4% ➖ noise
16 duckdb:vortex-compact -6.3% +1.7% -7.9% +42.4% ➖ noise
16 duckdb:vortex-file-compressed +13.5% +1.7% +11.6% +57.9% ➖ noise
17 datafusion:vortex-compact +34.7% -10.1% +50.0% +42.4% 🚨 regression
17 datafusion:vortex-file-compressed -25.6% -10.1% -17.2% +70.8% ➖ noise
17 duckdb:vortex-compact +12.3% -10.1% +25.0% +42.4% ➖ noise
17 duckdb:vortex-file-compressed +7.3% -10.1% +19.4% +42.4% ➖ noise
18 datafusion:vortex-compact +17.1% -9.9% +29.9% +42.4% ➖ noise
18 datafusion:vortex-file-compressed -39.7% -9.9% -33.1% +86.1% ➖ noise
18 duckdb:vortex-compact -2.5% -9.9% +8.2% +42.4% ➖ noise
18 duckdb:vortex-file-compressed -11.9% -9.9% -2.3% +42.4% ➖ noise
19 datafusion:vortex-compact +40.4% -5.9% +49.3% +42.4% 🚨 regression
19 datafusion:vortex-file-compressed -45.9% -5.9% -42.5% +52.3% ✅ faster
19 duckdb:vortex-compact +8.8% -5.9% +15.7% +42.4% ➖ noise
19 duckdb:vortex-file-compressed +16.4% -5.9% +23.7% +42.4% ➖ noise
20 datafusion:vortex-compact +10.6% -9.4% +22.1% +42.4% ➖ noise
20 datafusion:vortex-file-compressed -38.8% -9.4% -32.5% +42.4% ✅ faster
20 duckdb:vortex-compact -19.6% -9.4% -11.3% +42.4% ➖ noise
20 duckdb:vortex-file-compressed -6.6% -9.4% +3.1% +42.4% ➖ noise
21 datafusion:vortex-compact +28.0% +6.3% +20.4% +42.4% ➖ noise
21 datafusion:vortex-file-compressed -34.6% +6.3% -38.5% +46.8% ✅ faster
21 duckdb:vortex-compact -7.3% +6.3% -12.8% +42.4% ➖ noise
21 duckdb:vortex-file-compressed +18.1% +6.3% +11.1% +42.4% ➖ noise
22 datafusion:vortex-compact -20.8% +26.0% -37.1% +54.8% ✅ faster
22 datafusion:vortex-file-compressed -4.8% +26.0% -24.5% +60.4% ➖ noise
22 duckdb:vortex-compact +6.4% +26.0% -15.5% +42.4% ➖ noise
22 duckdb:vortex-file-compressed +3.7% +26.0% -17.7% +42.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +2.9%
Vortex (geomean): 1.149x ➖
Parquet (geomean): 1.117x ➖
Shifts: Parquet (control) +11.7% · Median polish +10.6%

datafusion / vortex-file-compressed (1.226x ➖, 0↑ 3↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 🚨 49013363 35718117 1.37
fineweb_q01/datafusion:vortex-file-compressed 585357578 475951864 1.23
fineweb_q02/datafusion:vortex-file-compressed 611022485 593509387 1.03
fineweb_q03/datafusion:vortex-file-compressed 1534871544 1340716220 1.14
fineweb_q04/datafusion:vortex-file-compressed 1467776402 1367032925 1.07
fineweb_q05/datafusion:vortex-file-compressed 1399499711 1340693861 1.04
fineweb_q06/datafusion:vortex-file-compressed 🚨 2178271495 1457030658 1.50
fineweb_q07/datafusion:vortex-file-compressed 🚨 2237117518 1323925076 1.69
fineweb_q08/datafusion:vortex-file-compressed 600102665 540100328 1.11
datafusion / vortex-compact (0.987x ➖, 1↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 40710083 32852202 1.24
fineweb_q01/datafusion:vortex-compact 621910083 607616900 1.02
fineweb_q02/datafusion:vortex-compact 831641322 771649108 1.08
fineweb_q03/datafusion:vortex-compact 1878114534 1831851457 1.03
fineweb_q04/datafusion:vortex-compact 2278665107 2263145091 1.01
fineweb_q05/datafusion:vortex-compact 1738800474 1725366509 1.01
fineweb_q06/datafusion:vortex-compact 1483597322 1615371599 0.92
fineweb_q07/datafusion:vortex-compact 1399076166 1403973133 1.00
fineweb_q08/datafusion:vortex-compact 🚀 432102735 633849682 0.68
datafusion / parquet (1.143x ➖, 0↑ 1↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1491222132 1493573435 1.00
fineweb_q01/datafusion:parquet 2107667202 2046345635 1.03
fineweb_q02/datafusion:parquet 1987449832 1787285770 1.11
fineweb_q03/datafusion:parquet 2267425408 1847940360 1.23
fineweb_q04/datafusion:parquet 2312196064 2000458670 1.16
fineweb_q05/datafusion:parquet 2122022440 1983554358 1.07
fineweb_q06/datafusion:parquet 2294755920 1778464741 1.29
fineweb_q07/datafusion:parquet 2120583285 1995135316 1.06
fineweb_q08/datafusion:parquet 🚨 2353346727 1685943088 1.40
duckdb / vortex-file-compressed (1.198x ➖, 0↑ 2↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 120559757 102414954 1.18
fineweb_q01/duckdb:vortex-file-compressed 🚨 704264198 536784326 1.31
fineweb_q02/duckdb:vortex-file-compressed 🚨 601988843 433233618 1.39
fineweb_q03/duckdb:vortex-file-compressed 1872145403 1560295848 1.20
fineweb_q04/duckdb:vortex-file-compressed 1760030112 1557544867 1.13
fineweb_q05/duckdb:vortex-file-compressed 1650957263 1474919952 1.12
fineweb_q06/duckdb:vortex-file-compressed 1947362418 1642342570 1.19
fineweb_q07/duckdb:vortex-file-compressed 1631642433 1466634013 1.11
fineweb_q08/duckdb:vortex-file-compressed 784832987 665789972 1.18
duckdb / vortex-compact (1.204x ➖, 0↑ 2↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 117960038 76230465 1.55
fineweb_q01/duckdb:vortex-compact 724027902 579140692 1.25
fineweb_q02/duckdb:vortex-compact 🚨 750326222 549089402 1.37
fineweb_q03/duckdb:vortex-compact 1806254410 1693246632 1.07
fineweb_q04/duckdb:vortex-compact 1935106212 1682209544 1.15
fineweb_q05/duckdb:vortex-compact 1729420817 1498705757 1.15
fineweb_q06/duckdb:vortex-compact 1641967528 1416641542 1.16
fineweb_q07/duckdb:vortex-compact 1543607488 1283028986 1.20
fineweb_q08/duckdb:vortex-compact 508694997 501082327 1.02
duckdb / parquet (1.092x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1225398992 1113483179 1.10
fineweb_q01/duckdb:parquet 1672614521 1595885776 1.05
fineweb_q02/duckdb:parquet 1810322954 1641711043 1.10
fineweb_q03/duckdb:parquet 4408591764 3995281080 1.10
fineweb_q04/duckdb:parquet 2069148071 1803584284 1.15
fineweb_q05/duckdb:parquet 2790908587 2575450562 1.08
fineweb_q06/duckdb:parquet 3540604579 3317102931 1.07
fineweb_q07/duckdb:parquet 4249307642 3958843726 1.07
fineweb_q08/duckdb:parquet 1249611973 1127769870 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +23.9% +4.8% +18.2% +130.2% ➖ noise
0 datafusion:vortex-file-compressed +37.2% +4.8% +30.9% +160.9% ➖ noise
0 duckdb:vortex-compact +54.7% +4.8% +47.6% +43.2% 🚨 regression
0 duckdb:vortex-file-compressed +17.7% +4.8% +12.3% +36.4% ➖ noise
1 datafusion:vortex-compact +2.4% +3.9% -1.5% +57.3% ➖ noise
1 datafusion:vortex-file-compressed +23.0% +3.9% +18.4% +64.7% ➖ noise
1 duckdb:vortex-compact +25.0% +3.9% +20.3% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +31.2% +3.9% +26.3% +30.0% ➖ noise
2 datafusion:vortex-compact +7.8% +10.7% -2.7% +30.0% ➖ noise
2 datafusion:vortex-file-compressed +3.0% +10.7% -7.0% +30.0% ➖ noise
2 duckdb:vortex-compact +36.6% +10.7% +23.4% +30.0% ➖ noise
2 duckdb:vortex-file-compressed +39.0% +10.7% +25.5% +37.6% ➖ noise
3 datafusion:vortex-compact +2.5% +16.4% -11.9% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +14.5% +16.4% -1.6% +30.0% ➖ noise
3 duckdb:vortex-compact +6.7% +16.4% -8.3% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +20.0% +16.4% +3.1% +30.0% ➖ noise
4 datafusion:vortex-compact +0.7% +15.2% -12.6% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +7.4% +15.2% -6.8% +30.0% ➖ noise
4 duckdb:vortex-compact +15.0% +15.2% -0.1% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +13.0% +15.2% -1.9% +30.0% ➖ noise
5 datafusion:vortex-compact +0.8% +7.7% -6.4% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +4.4% +7.7% -3.1% +30.0% ➖ noise
5 duckdb:vortex-compact +15.4% +7.7% +7.2% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +11.9% +7.7% +4.0% +30.0% ➖ noise
6 datafusion:vortex-compact -8.2% +17.4% -21.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +49.5% +17.4% +27.4% +30.4% ➖ noise
6 duckdb:vortex-compact +15.9% +17.4% -1.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +18.6% +17.4% +1.0% +30.0% ➖ noise
7 datafusion:vortex-compact -0.3% +6.8% -6.7% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +69.0% +6.8% +58.2% +30.0% 🚨 regression
7 duckdb:vortex-compact +20.3% +6.8% +12.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +11.3% +6.8% +4.2% +30.0% ➖ noise
8 datafusion:vortex-compact -31.8% +24.4% -45.2% +30.0% ✅ faster
8 datafusion:vortex-file-compressed +11.1% +24.4% -10.7% +30.0% ➖ noise
8 duckdb:vortex-compact +1.5% +24.4% -18.4% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +17.9% +24.4% -5.2% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Mar 27, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -8.8%
Vortex (geomean): 1.065x ➖
Parquet (geomean): 1.168x ➖
Shifts: Parquet (control) +16.8% · Median polish +8.8%

datafusion / vortex-file-compressed (1.092x ➖, 1↑ 5↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 787852706 758260599 1.04
tpch_q02/datafusion:vortex-file-compressed 🚀 731676246 1115473626 0.66
tpch_q03/datafusion:vortex-file-compressed 1096129651 1178722714 0.93
tpch_q04/datafusion:vortex-file-compressed 704664865 727085959 0.97
tpch_q05/datafusion:vortex-file-compressed 1227379725 958320828 1.28
tpch_q06/datafusion:vortex-file-compressed 🚨 854115086 586452038 1.46
tpch_q07/datafusion:vortex-file-compressed 🚨 1600730663 1025690990 1.56
tpch_q08/datafusion:vortex-file-compressed 🚨 1628510511 1101596098 1.48
tpch_q09/datafusion:vortex-file-compressed 1390288763 1400486646 0.99
tpch_q10/datafusion:vortex-file-compressed 1276271268 1056037482 1.21
tpch_q11/datafusion:vortex-file-compressed 603210536 562068200 1.07
tpch_q12/datafusion:vortex-file-compressed 1065657931 910940131 1.17
tpch_q13/datafusion:vortex-file-compressed 419316635 441801733 0.95
tpch_q14/datafusion:vortex-file-compressed 644745265 598517007 1.08
tpch_q15/datafusion:vortex-file-compressed 1309805701 1107607974 1.18
tpch_q16/datafusion:vortex-file-compressed 345160077 352103814 0.98
tpch_q17/datafusion:vortex-file-compressed 1458082990 1166718565 1.25
tpch_q18/datafusion:vortex-file-compressed 🚨 1723842354 1275883085 1.35
tpch_q19/datafusion:vortex-file-compressed 1037314509 1158649267 0.90
tpch_q20/datafusion:vortex-file-compressed 1084139796 1419694990 0.76
tpch_q21/datafusion:vortex-file-compressed 1900096248 2152154145 0.88
tpch_q22/datafusion:vortex-file-compressed 🚨 655592967 459288113 1.43
datafusion / vortex-compact (1.234x ➖, 0↑ 5↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 764977988 731651636 1.05
tpch_q02/datafusion:vortex-compact 637453891 763289308 0.84
tpch_q03/datafusion:vortex-compact 🚨 1579251489 710537834 2.22
tpch_q04/datafusion:vortex-compact 🚨 1044870565 573295510 1.82
tpch_q05/datafusion:vortex-compact 🚨 1373673128 876479086 1.57
tpch_q06/datafusion:vortex-compact 739710100 574900352 1.29
tpch_q07/datafusion:vortex-compact 1082626026 1001380092 1.08
tpch_q08/datafusion:vortex-compact 1160389193 1006211086 1.15
tpch_q09/datafusion:vortex-compact 1336439770 1252859845 1.07
tpch_q10/datafusion:vortex-compact 984872151 1218190846 0.81
tpch_q11/datafusion:vortex-compact 462903663 396738869 1.17
tpch_q12/datafusion:vortex-compact 1091643020 894468811 1.22
tpch_q13/datafusion:vortex-compact 507598029 402985943 1.26
tpch_q14/datafusion:vortex-compact 700594801 573020048 1.22
tpch_q15/datafusion:vortex-compact 1294422047 1049173740 1.23
tpch_q16/datafusion:vortex-compact 345821798 310768893 1.11
tpch_q17/datafusion:vortex-compact 1399124327 1179884045 1.19
tpch_q18/datafusion:vortex-compact 1417003958 1203290344 1.18
tpch_q19/datafusion:vortex-compact 🚨 1061837639 638608823 1.66
tpch_q20/datafusion:vortex-compact 985009458 906321499 1.09
tpch_q21/datafusion:vortex-compact 1566085527 1542415287 1.02
tpch_q22/datafusion:vortex-compact 🚨 812203977 474633796 1.71
datafusion / parquet (1.230x ➖, 0↑ 8↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 810656478 785964646 1.03
tpch_q02/datafusion:parquet 622124234 674120121 0.92
tpch_q03/datafusion:parquet 1015945413 1269609308 0.80
tpch_q04/datafusion:parquet 641994938 526391272 1.22
tpch_q05/datafusion:parquet 🚨 2164484557 1429827240 1.51
tpch_q06/datafusion:parquet 🚨 747358012 545516065 1.37
tpch_q07/datafusion:parquet 🚨 2148161024 1424584859 1.51
tpch_q08/datafusion:parquet 🚨 2225913879 1706701252 1.30
tpch_q09/datafusion:parquet 2230969440 1818522292 1.23
tpch_q10/datafusion:parquet 2439658823 2292603828 1.06
tpch_q11/datafusion:parquet 598530003 610315554 0.98
tpch_q12/datafusion:parquet 🚨 1132365239 719031711 1.57
tpch_q13/datafusion:parquet 921324319 798071150 1.15
tpch_q14/datafusion:parquet 1035287298 808520852 1.28
tpch_q15/datafusion:parquet 1391971617 1155529658 1.20
tpch_q16/datafusion:parquet 🚨 630836999 392511486 1.61
tpch_q17/datafusion:parquet 🚨 2027144338 1311133200 1.55
tpch_q18/datafusion:parquet 2245940234 2118342803 1.06
tpch_q19/datafusion:parquet 1019441949 950028135 1.07
tpch_q20/datafusion:parquet 1114782539 1217028654 0.92
tpch_q21/datafusion:parquet 2287518476 1816804697 1.26
tpch_q22/datafusion:parquet 🚨 1497300890 698072252 2.14
duckdb / vortex-file-compressed (1.012x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 709638185 644975497 1.10
tpch_q02/duckdb:vortex-file-compressed 1089776310 1146392784 0.95
tpch_q03/duckdb:vortex-file-compressed 1172703761 966553337 1.21
tpch_q04/duckdb:vortex-file-compressed 696019860 592127560 1.18
tpch_q05/duckdb:vortex-file-compressed 1158441763 1039920733 1.11
tpch_q06/duckdb:vortex-file-compressed 831899853 882177442 0.94
tpch_q07/duckdb:vortex-file-compressed 1208378018 1118936295 1.08
tpch_q08/duckdb:vortex-file-compressed 1437301247 1654280902 0.87
tpch_q09/duckdb:vortex-file-compressed 1521032433 1552254157 0.98
tpch_q10/duckdb:vortex-file-compressed 1308261957 1274317117 1.03
tpch_q11/duckdb:vortex-file-compressed 784695615 768885025 1.02
tpch_q12/duckdb:vortex-file-compressed 925618361 728262108 1.27
tpch_q13/duckdb:vortex-file-compressed 952714241 1185709027 0.80
tpch_q14/duckdb:vortex-file-compressed 1002901446 951296681 1.05
tpch_q15/duckdb:vortex-file-compressed 671580083 541606628 1.24
tpch_q16/duckdb:vortex-file-compressed 415622504 440248329 0.94
tpch_q17/duckdb:vortex-file-compressed 1098527233 997817420 1.10
tpch_q18/duckdb:vortex-file-compressed 1039366496 1191353433 0.87
tpch_q19/duckdb:vortex-file-compressed 858769696 829456705 1.04
tpch_q20/duckdb:vortex-file-compressed 1396820849 1742712225 0.80
tpch_q21/duckdb:vortex-file-compressed 2098625069 1945788145 1.08
tpch_q22/duckdb:vortex-file-compressed 693838017 874272274 0.79
duckdb / vortex-compact (0.944x ➖, 0↑ 0↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 604961391 725047140 0.83
tpch_q02/duckdb:vortex-compact 1060128057 1016905445 1.04
tpch_q03/duckdb:vortex-compact 886353941 968645616 0.92
tpch_q04/duckdb:vortex-compact 488003714 566480570 0.86
tpch_q05/duckdb:vortex-compact 1052060009 1041983107 1.01
tpch_q06/duckdb:vortex-compact 802609000 829664074 0.97
tpch_q07/duckdb:vortex-compact 1075607418 1057497458 1.02
tpch_q08/duckdb:vortex-compact 1438449306 1547583064 0.93
tpch_q09/duckdb:vortex-compact 1486132501 1622096546 0.92
tpch_q10/duckdb:vortex-compact 1252251152 1382671262 0.91
tpch_q11/duckdb:vortex-compact 876654856 730368006 1.20
tpch_q12/duckdb:vortex-compact 728675140 678828540 1.07
tpch_q13/duckdb:vortex-compact 942589167 934347799 1.01
tpch_q14/duckdb:vortex-compact 850045326 925392942 0.92
tpch_q15/duckdb:vortex-compact 546181300 568820836 0.96
tpch_q16/duckdb:vortex-compact 402623493 509584803 0.79
tpch_q17/duckdb:vortex-compact 935416995 902781212 1.04
tpch_q18/duckdb:vortex-compact 810879444 1123748138 0.72
tpch_q19/duckdb:vortex-compact 807353853 829698075 0.97
tpch_q20/duckdb:vortex-compact 1271785471 1637683704 0.78
tpch_q21/duckdb:vortex-compact 1855119450 1918110396 0.97
tpch_q22/duckdb:vortex-compact 829102705 765342041 1.08
duckdb / parquet (1.108x ➖, 0↑ 3↓)
name PR ba53919 (ns) base 1f3206f (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 🚨 1199734303 857590439 1.40
tpch_q02/duckdb:parquet 1697643207 1546486625 1.10
tpch_q03/duckdb:parquet 1810072025 1555936981 1.16
tpch_q04/duckdb:parquet 1317791792 1120427451 1.18
tpch_q05/duckdb:parquet 2417705461 2024490613 1.19
tpch_q06/duckdb:parquet 🚨 879109303 660356760 1.33
tpch_q07/duckdb:parquet 1992815309 1772537255 1.12
tpch_q08/duckdb:parquet 2768358710 2643261138 1.05
tpch_q09/duckdb:parquet 2478707342 2273700854 1.09
tpch_q10/duckdb:parquet 3727762442 2980604021 1.25
tpch_q11/duckdb:parquet 1016930175 1104722706 0.92
tpch_q12/duckdb:parquet 🚨 1209006125 908901184 1.33
tpch_q13/duckdb:parquet 1270683814 1179119147 1.08
tpch_q14/duckdb:parquet 1328322139 1258310376 1.06
tpch_q15/duckdb:parquet 809717211 870859466 0.93
tpch_q16/duckdb:parquet 853866962 743572734 1.15
tpch_q17/duckdb:parquet 1355138747 1299374814 1.04
tpch_q18/duckdb:parquet 1272844246 1364775491 0.93
tpch_q19/duckdb:parquet 1647798298 1569920032 1.05
tpch_q20/duckdb:parquet 1938551109 1837255219 1.06
tpch_q21/duckdb:parquet 2054935518 1940447089 1.06
tpch_q22/duckdb:parquet 1050575654 996082814 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +4.6% +20.1% -13.0% +54.9% ➖ noise
1 datafusion:vortex-file-compressed +3.9% +20.1% -13.5% +64.3% ➖ noise
1 duckdb:vortex-compact -16.6% +20.1% -30.5% +40.9% ✅ faster
1 duckdb:vortex-file-compressed +10.0% +20.1% -8.4% +40.9% ➖ noise
2 datafusion:vortex-compact -16.5% +0.7% -17.0% +45.9% ➖ noise
2 datafusion:vortex-file-compressed -34.4% +0.7% -34.8% +40.9% ✅ faster
2 duckdb:vortex-compact +4.3% +0.7% +3.6% +43.2% ➖ noise
2 duckdb:vortex-file-compressed -4.9% +0.7% -5.6% +44.2% ➖ noise
3 datafusion:vortex-compact +122.3% -3.5% +130.4% +72.4% 🚨 regression
3 datafusion:vortex-file-compressed -7.0% -3.5% -3.6% +48.9% ➖ noise
3 duckdb:vortex-compact -8.5% -3.5% -5.2% +44.3% ➖ noise
3 duckdb:vortex-file-compressed +21.3% -3.5% +25.8% +43.8% ➖ noise
4 datafusion:vortex-compact +82.3% +19.8% +52.2% +40.9% 🚨 regression
4 datafusion:vortex-file-compressed -3.1% +19.8% -19.1% +40.9% ➖ noise
4 duckdb:vortex-compact -13.9% +19.8% -28.1% +40.9% ➖ noise
4 duckdb:vortex-file-compressed +17.5% +19.8% -1.9% +40.9% ➖ noise
5 datafusion:vortex-compact +56.7% +34.5% +16.6% +40.9% ➖ noise
5 datafusion:vortex-file-compressed +28.1% +34.5% -4.7% +40.9% ➖ noise
5 duckdb:vortex-compact +1.0% +34.5% -24.9% +40.9% ➖ noise
5 duckdb:vortex-file-compressed +11.4% +34.5% -17.1% +40.9% ➖ noise
6 datafusion:vortex-compact +28.7% +35.0% -4.7% +40.9% ➖ noise
6 datafusion:vortex-file-compressed +45.6% +35.0% +7.8% +40.9% ➖ noise
6 duckdb:vortex-compact -3.3% +35.0% -28.4% +40.9% ➖ noise
6 duckdb:vortex-file-compressed -5.7% +35.0% -30.2% +40.9% ✅ faster
7 datafusion:vortex-compact +8.1% +30.2% -17.0% +40.9% ➖ noise
7 datafusion:vortex-file-compressed +56.1% +30.2% +19.9% +40.9% ➖ noise
7 duckdb:vortex-compact +1.7% +30.2% -21.9% +40.9% ➖ noise
7 duckdb:vortex-file-compressed +8.0% +30.2% -17.1% +40.9% ➖ noise
8 datafusion:vortex-compact +15.3% +16.9% -1.3% +40.9% ➖ noise
8 datafusion:vortex-file-compressed +47.8% +16.9% +26.5% +40.9% ➖ noise
8 duckdb:vortex-compact -7.1% +16.9% -20.5% +40.9% ➖ noise
8 duckdb:vortex-file-compressed -13.1% +16.9% -25.7% +40.9% ➖ noise
9 datafusion:vortex-compact +6.7% +15.6% -7.8% +40.9% ➖ noise
9 datafusion:vortex-file-compressed -0.7% +15.6% -14.2% +40.9% ➖ noise
9 duckdb:vortex-compact -8.4% +15.6% -20.8% +40.9% ➖ noise
9 duckdb:vortex-file-compressed -2.0% +15.6% -15.3% +40.9% ➖ noise
10 datafusion:vortex-compact -19.2% +15.4% -29.9% +40.9% ✅ faster
10 datafusion:vortex-file-compressed +20.9% +15.4% +4.8% +40.9% ➖ noise
10 duckdb:vortex-compact -9.4% +15.4% -21.5% +40.9% ➖ noise
10 duckdb:vortex-file-compressed +2.7% +15.4% -11.0% +41.5% ➖ noise
11 datafusion:vortex-compact +16.7% -5.0% +22.8% +40.9% ➖ noise
11 datafusion:vortex-file-compressed +7.3% -5.0% +13.0% +40.9% ➖ noise
11 duckdb:vortex-compact +20.0% -5.0% +26.3% +40.9% ➖ noise
11 duckdb:vortex-file-compressed +2.1% -5.0% +7.4% +43.3% ➖ noise
12 datafusion:vortex-compact +22.0% +44.7% -15.7% +40.9% ➖ noise
12 datafusion:vortex-file-compressed +17.0% +44.7% -19.2% +40.9% ➖ noise
12 duckdb:vortex-compact +7.3% +44.7% -25.8% +42.0% ➖ noise
12 duckdb:vortex-file-compressed +27.1% +44.7% -12.2% +40.9% ➖ noise
13 datafusion:vortex-compact +26.0% +11.5% +12.9% +40.9% ➖ noise
13 datafusion:vortex-file-compressed -5.1% +11.5% -14.9% +41.2% ➖ noise
13 duckdb:vortex-compact +0.9% +11.5% -9.6% +64.7% ➖ noise
13 duckdb:vortex-file-compressed -19.7% +11.5% -28.0% +47.3% ➖ noise
14 datafusion:vortex-compact +22.3% +16.3% +5.2% +40.9% ➖ noise
14 datafusion:vortex-file-compressed +7.7% +16.3% -7.3% +40.9% ➖ noise
14 duckdb:vortex-compact -8.1% +16.3% -21.0% +40.9% ➖ noise
14 duckdb:vortex-file-compressed +5.4% +16.3% -9.3% +40.9% ➖ noise
15 datafusion:vortex-compact +23.4% +5.8% +16.6% +40.9% ➖ noise
15 datafusion:vortex-file-compressed +18.3% +5.8% +11.7% +40.9% ➖ noise
15 duckdb:vortex-compact -4.0% +5.8% -9.3% +40.9% ➖ noise
15 duckdb:vortex-file-compressed +24.0% +5.8% +17.2% +40.9% ➖ noise
16 datafusion:vortex-compact +11.3% +35.9% -18.1% +40.9% ➖ noise
16 datafusion:vortex-file-compressed -2.0% +35.9% -27.8% +57.6% ➖ noise
16 duckdb:vortex-compact -21.0% +35.9% -41.8% +45.7% ✅ faster
16 duckdb:vortex-file-compressed -5.6% +35.9% -30.5% +40.9% ✅ faster
17 datafusion:vortex-compact +18.6% +27.0% -6.6% +40.9% ➖ noise
17 datafusion:vortex-file-compressed +25.0% +27.0% -1.6% +40.9% ➖ noise
17 duckdb:vortex-compact +3.6% +27.0% -18.4% +40.9% ➖ noise
17 duckdb:vortex-file-compressed +10.1% +27.0% -13.3% +40.9% ➖ noise
18 datafusion:vortex-compact +17.8% -0.6% +18.4% +40.9% ➖ noise
18 datafusion:vortex-file-compressed +35.1% -0.6% +35.9% +40.9% ➖ noise
18 duckdb:vortex-compact -27.8% -0.6% -27.4% +41.9% ➖ noise
18 duckdb:vortex-file-compressed -12.8% -0.6% -12.3% +40.9% ➖ noise
19 datafusion:vortex-compact +66.3% +6.1% +56.7% +40.9% 🚨 regression
19 datafusion:vortex-file-compressed -10.5% +6.1% -15.6% +54.4% ➖ noise
19 duckdb:vortex-compact -2.7% +6.1% -8.3% +40.9% ➖ noise
19 duckdb:vortex-file-compressed +3.5% +6.1% -2.4% +40.9% ➖ noise
20 datafusion:vortex-compact +8.7% -1.7% +10.6% +40.9% ➖ noise
20 datafusion:vortex-file-compressed -23.6% -1.7% -22.3% +40.9% ➖ noise
20 duckdb:vortex-compact -22.3% -1.7% -21.0% +40.9% ➖ noise
20 duckdb:vortex-file-compressed -19.8% -1.7% -18.5% +40.9% ➖ noise
21 datafusion:vortex-compact +1.5% +15.5% -12.1% +40.9% ➖ noise
21 datafusion:vortex-file-compressed -11.7% +15.5% -23.5% +40.9% ➖ noise
21 duckdb:vortex-compact -3.3% +15.5% -16.2% +40.9% ➖ noise
21 duckdb:vortex-file-compressed +7.9% +15.5% -6.6% +40.9% ➖ noise
22 datafusion:vortex-compact +71.1% +50.4% +13.8% +46.3% ➖ noise
22 datafusion:vortex-file-compressed +42.7% +50.4% -5.1% +53.6% ➖ noise
22 duckdb:vortex-compact +8.3% +50.4% -28.0% +40.9% ➖ noise
22 duckdb:vortex-file-compressed -20.6% +50.4% -47.2% +40.9% ✅ faster

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@robert3005 robert3005 robert3005 approved these changes

@gatesn gatesn Awaiting requested review from gatesn

@AdamGS AdamGS Awaiting requested review from AdamGS

Assignees

No one assigned

Labels

changelog/chore A trivial change

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@a10y @robert3005 @gatesn